2019-03-21 12:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 12:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 12:25:08 [DEBUG   ] Finished updating ant stats in 1.232 seconds
2019-03-21 12:25:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:25:09 [DEBUG   ] Got command BAM from MCS: ref #90789
2019-03-21 12:25:09 [INFO    ] Finished processing BAM request
2019-03-21 12:25:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90789   8 58563 44709035 A  ERROR'
2019-03-21 12:25:09 [DEBUG   ] Got command BAM from MCS: ref #90790
2019-03-21 12:25:09 [INFO    ] Finished processing BAM request
2019-03-21 12:25:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90790   8 58563 44709043 A  ERROR'
2019-03-21 12:25:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 12:25:09 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 12:25:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:25:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:25:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:25:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:25:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:25:09 [DEBUG   ] Finished updating board flags in 1.548 seconds
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 12:25:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 12:25:09 [DEBUG   ] spawn_process: at 2019-03-21 12:25:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 12:25:28 [DEBUG   ] Finished updating ant stats in 1.148 seconds
2019-03-21 12:25:39 [DEBUG   ] Got command BAM from MCS: ref #90792
2019-03-21 12:25:39 [INFO    ] Finished processing BAM request
2019-03-21 12:25:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90792   8 58563 44739023 A  ERROR'
2019-03-21 12:25:39 [DEBUG   ] Got command BAM from MCS: ref #90791
2019-03-21 12:25:39 [INFO    ] Finished processing BAM request
2019-03-21 12:25:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:25:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90791   8 58563 44739027 A  ERROR'
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 12:25:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 12:25:39 [DEBUG   ] spawn_process: at 2019-03-21 12:25:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 12:25:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 12:26:08 [DEBUG   ] Finished updating ant stats in 1.032 seconds
2019-03-21 12:26:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:26:09 [DEBUG   ] Got command BAM from MCS: ref #90794
2019-03-21 12:26:09 [INFO    ] Finished processing BAM request
2019-03-21 12:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90794   8 58563 44769031 A  ERROR'
2019-03-21 12:26:09 [DEBUG   ] Got command BAM from MCS: ref #90793
2019-03-21 12:26:09 [INFO    ] Finished processing BAM request
2019-03-21 12:26:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:26:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90793   8 58563 44769035 A  ERROR'
2019-03-21 12:26:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 12:26:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 12:26:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:26:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:26:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:26:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:26:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:26:09 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 12:26:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 12:26:09 [DEBUG   ] spawn_process: at 2019-03-21 12:26:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 12:26:28 [DEBUG   ] Finished updating ant stats in 0.969 seconds
2019-03-21 12:26:37 [DEBUG   ] Got command RPT from MCS: ref #90797
2019-03-21 12:26:37 [DEBUG   ] summary = ERROR
2019-03-21 12:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90797  13 58563 44797475 A  ERRORERROR'
2019-03-21 12:26:37 [DEBUG   ] Got command RPT from MCS: ref #90798
2019-03-21 12:26:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90798  77 58563 44797679 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:26:37 [DEBUG   ] Got command RPT from MCS: ref #90799
2019-03-21 12:26:37 [DEBUG   ] summary = ERROR
2019-03-21 12:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90799  13 58563 44797871 A  ERRORERROR'
2019-03-21 12:26:38 [DEBUG   ] Got command RPT from MCS: ref #90803
2019-03-21 12:26:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90803  77 58563 44798075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:26:38 [DEBUG   ] Got command RPT from MCS: ref #90804
2019-03-21 12:26:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 12:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90804  12 58563 44798279 A  ERRORB ff'
2019-03-21 12:26:39 [DEBUG   ] Got command BAM from MCS: ref #90801
2019-03-21 12:26:39 [INFO    ] Finished processing BAM request
2019-03-21 12:26:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90801   8 58563 44799027 A  ERROR'
2019-03-21 12:26:39 [DEBUG   ] Got command BAM from MCS: ref #90800
2019-03-21 12:26:39 [INFO    ] Finished processing BAM request
2019-03-21 12:26:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90800   8 58563 44799031 A  ERROR'
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 12:26:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 12:26:39 [DEBUG   ] spawn_process: at 2019-03-21 12:26:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 12:26:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 12:27:08 [DEBUG   ] Finished updating ant stats in 0.636 seconds
2019-03-21 12:27:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:27:09 [DEBUG   ] Got command BAM from MCS: ref #90816
2019-03-21 12:27:09 [INFO    ] Finished processing BAM request
2019-03-21 12:27:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90816   8 58563 44829027 A  ERROR'
2019-03-21 12:27:09 [DEBUG   ] Got command BAM from MCS: ref #90815
2019-03-21 12:27:09 [INFO    ] Finished processing BAM request
2019-03-21 12:27:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:27:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90815   8 58563 44829031 A  ERROR'
2019-03-21 12:27:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:27:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:27:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:27:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:27:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:27:09 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 12:27:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 12:27:09 [DEBUG   ] spawn_process: at 2019-03-21 12:27:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 12:27:29 [DEBUG   ] Finished updating ant stats in 1.568 seconds
2019-03-21 12:27:39 [DEBUG   ] Got command BAM from MCS: ref #90817
2019-03-21 12:27:39 [INFO    ] Finished processing BAM request
2019-03-21 12:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90817   8 58563 44859023 A  ERROR'
2019-03-21 12:27:39 [DEBUG   ] Got command BAM from MCS: ref #90818
2019-03-21 12:27:39 [INFO    ] Finished processing BAM request
2019-03-21 12:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90818   8 58563 44859027 A  ERROR'
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 12:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 12:27:39 [DEBUG   ] spawn_process: at 2019-03-21 12:27:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 12:27:40 [DEBUG   ] Got command RPT from MCS: ref #90819
2019-03-21 12:27:40 [DEBUG   ] summary = ERROR
2019-03-21 12:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90819  13 58563 44860735 A  ERRORERROR'
2019-03-21 12:27:40 [DEBUG   ] Got command RPT from MCS: ref #90820
2019-03-21 12:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90820  77 58563 44860735 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:27:48 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 12:28:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:28:09 [DEBUG   ] Got command BAM from MCS: ref #90836
2019-03-21 12:28:09 [INFO    ] Finished processing BAM request
2019-03-21 12:28:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90836   8 58563 44889027 A  ERROR'
2019-03-21 12:28:09 [DEBUG   ] Got command BAM from MCS: ref #90837
2019-03-21 12:28:09 [INFO    ] Finished processing BAM request
2019-03-21 12:28:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90837   8 58563 44889031 A  ERROR'
2019-03-21 12:28:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 12:28:09 [DEBUG   ] Finished updating ant stats in 1.231 seconds
2019-03-21 12:28:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 12:28:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:28:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:28:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:28:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:28:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:28:09 [DEBUG   ] Finished updating board flags in 1.266 seconds
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 12:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 12:28:09 [DEBUG   ] spawn_process: at 2019-03-21 12:28:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 12:28:29 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2019-03-21 12:28:39 [DEBUG   ] Got command BAM from MCS: ref #90839
2019-03-21 12:28:39 [INFO    ] Finished processing BAM request
2019-03-21 12:28:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90839   8 58563 44919027 A  ERROR'
2019-03-21 12:28:39 [DEBUG   ] Got command BAM from MCS: ref #90838
2019-03-21 12:28:39 [INFO    ] Finished processing BAM request
2019-03-21 12:28:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90838   8 58563 44919031 A  ERROR'
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 12:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 12:28:39 [DEBUG   ] spawn_process: at 2019-03-21 12:28:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 12:28:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 12:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 12:29:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:29:09 [DEBUG   ] Got command BAM from MCS: ref #90840
2019-03-21 12:29:09 [INFO    ] Finished processing BAM request
2019-03-21 12:29:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90840   8 58563 44949023 A  ERROR'
2019-03-21 12:29:09 [DEBUG   ] Got command BAM from MCS: ref #90841
2019-03-21 12:29:09 [INFO    ] Finished processing BAM request
2019-03-21 12:29:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90841   8 58563 44949027 A  ERROR'
2019-03-21 12:29:09 [DEBUG   ] Finished updating ant stats in 0.827 seconds
2019-03-21 12:29:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-03-21 12:29:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 12:29:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:29:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:29:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:29:09 [WARNING ] (13, 1, 'bot')
2019-03-21 12:29:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:29:09 [DEBUG   ] Finished updating board flags in 1.190 seconds
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 12:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 12:29:09 [DEBUG   ] spawn_process: at 2019-03-21 12:29:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 12:29:29 [DEBUG   ] Finished updating ant stats in 0.776 seconds
2019-03-21 12:29:39 [DEBUG   ] Got command BAM from MCS: ref #90842
2019-03-21 12:29:39 [INFO    ] Finished processing BAM request
2019-03-21 12:29:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90842   8 58563 44979023 A  ERROR'
2019-03-21 12:29:39 [DEBUG   ] Got command BAM from MCS: ref #90843
2019-03-21 12:29:39 [INFO    ] Finished processing BAM request
2019-03-21 12:29:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90843   8 58563 44979027 A  ERROR'
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 12:29:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 12:29:39 [DEBUG   ] spawn_process: at 2019-03-21 12:29:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 12:29:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:30:09 [DEBUG   ] Got command BAM from MCS: ref #90851
2019-03-21 12:30:09 [INFO    ] Finished processing BAM request
2019-03-21 12:30:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90851   8 58563 45009027 A  ERROR'
2019-03-21 12:30:09 [DEBUG   ] Got command BAM from MCS: ref #90850
2019-03-21 12:30:09 [INFO    ] Finished processing BAM request
2019-03-21 12:30:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90850   8 58563 45009031 A  ERROR'
2019-03-21 12:30:09 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2019-03-21 12:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 12:30:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 12:30:09 [DEBUG   ] spawn_process: at 2019-03-21 12:30:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 12:30:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 12:30:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:30:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:30:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:30:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:30:10 [DEBUG   ] Finished updating board flags in 1.971 seconds
2019-03-21 12:30:29 [DEBUG   ] Finished updating ant stats in 0.372 seconds
2019-03-21 12:30:39 [DEBUG   ] Got command BAM from MCS: ref #90852
2019-03-21 12:30:39 [INFO    ] Finished processing BAM request
2019-03-21 12:30:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90852   8 58563 45039027 A  ERROR'
2019-03-21 12:30:39 [DEBUG   ] Got command BAM from MCS: ref #90853
2019-03-21 12:30:39 [INFO    ] Finished processing BAM request
2019-03-21 12:30:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90853   8 58563 45039031 A  ERROR'
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 12:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 12:30:39 [DEBUG   ] spawn_process: at 2019-03-21 12:30:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 12:30:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:31:09 [DEBUG   ] Got command BAM from MCS: ref #90854
2019-03-21 12:31:09 [INFO    ] Finished processing BAM request
2019-03-21 12:31:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90854   8 58563 45069031 A  ERROR'
2019-03-21 12:31:09 [DEBUG   ] Got command BAM from MCS: ref #90855
2019-03-21 12:31:09 [INFO    ] Finished processing BAM request
2019-03-21 12:31:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 12:31:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    90855   8 58563 45069035 A  ERROR'
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 12:31:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 12:31:09 [DEBUG   ] spawn_process: at 2019-03-21 12:31:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 12:31:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 12:31:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 12:31:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:31:11 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 12:31:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:31:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:31:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:31:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:31:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:31:11 [DEBUG   ] Finished updating board flags in 2.780 seconds
2019-03-21 12:31:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:31:37 [DEBUG   ] Got command RPT from MCS: ref #90856
2019-03-21 12:31:37 [DEBUG   ] summary = ERROR
2019-03-21 12:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90856  13 58563 45097559 A  ERRORERROR'
2019-03-21 12:31:37 [DEBUG   ] Got command RPT from MCS: ref #90857
2019-03-21 12:31:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90857  77 58563 45097763 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:31:37 [DEBUG   ] Got command RPT from MCS: ref #90858
2019-03-21 12:31:37 [DEBUG   ] summary = ERROR
2019-03-21 12:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90858  13 58563 45097967 A  ERRORERROR'
2019-03-21 12:31:38 [DEBUG   ] Got command RPT from MCS: ref #90859
2019-03-21 12:31:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90859  77 58563 45098159 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:31:38 [DEBUG   ] Got command RPT from MCS: ref #90860
2019-03-21 12:31:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 12:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90860  12 58563 45098363 A  ERRORB ff'
2019-03-21 12:31:40 [DEBUG   ] Got command STP from MCS: ref #90861
2019-03-21 12:31:40 [INFO    ] Finished processing BAM request
2019-03-21 12:31:40 [INFO    ] Shutdown the adder chain on beam #2
2019-03-21 12:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    90861   8 58563 45100023 A  ERROR'
2019-03-21 12:31:40 [DEBUG   ] Got command STP from MCS: ref #90862
2019-03-21 12:31:40 [INFO    ] Finished processing BAM request
2019-03-21 12:31:40 [INFO    ] Shutdown the adder chain on beam #4
2019-03-21 12:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    90862   8 58563 45100027 A  ERROR'
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 12:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 12:31:40 [DEBUG   ] spawn_process: at 2019-03-21 12:31:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 12:31:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:32:10 [DEBUG   ] Finished updating ant stats in 1.026 seconds
2019-03-21 12:32:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:32:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:32:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:32:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:32:10 [DEBUG   ] Finished updating board flags in 1.648 seconds
2019-03-21 12:32:30 [DEBUG   ] Finished updating ant stats in 0.976 seconds
2019-03-21 12:32:40 [DEBUG   ] Got command RPT from MCS: ref #90869
2019-03-21 12:32:40 [DEBUG   ] summary = ERROR
2019-03-21 12:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90869  13 58563 45160739 A  ERRORERROR'
2019-03-21 12:32:40 [DEBUG   ] Got command RPT from MCS: ref #90870
2019-03-21 12:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90870  77 58563 45160739 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:32:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:33:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:33:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 12:33:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:33:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:33:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:33:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:33:10 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-03-21 12:33:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:33:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:34:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:34:10 [DEBUG   ] Finished updating ant stats in 0.825 seconds
2019-03-21 12:34:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:34:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:34:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:34:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:34:10 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-03-21 12:34:30 [DEBUG   ] Finished updating ant stats in 0.772 seconds
2019-03-21 12:34:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:35:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:35:10 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2019-03-21 12:35:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:35:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:35:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:35:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:35:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:35:10 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-03-21 12:35:30 [DEBUG   ] Finished updating ant stats in 0.572 seconds
2019-03-21 12:35:50 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 12:36:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:36:10 [DEBUG   ] Finished updating ant stats in 0.422 seconds
2019-03-21 12:36:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:36:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:36:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:36:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:36:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:36:10 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-03-21 12:36:30 [DEBUG   ] Finished updating ant stats in 0.376 seconds
2019-03-21 12:36:37 [DEBUG   ] Got command RPT from MCS: ref #90894
2019-03-21 12:36:37 [DEBUG   ] summary = ERROR
2019-03-21 12:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90894  13 58563 45397643 A  ERRORERROR'
2019-03-21 12:36:37 [DEBUG   ] Got command RPT from MCS: ref #90895
2019-03-21 12:36:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90895  77 58563 45397847 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:36:38 [DEBUG   ] Got command RPT from MCS: ref #90896
2019-03-21 12:36:38 [DEBUG   ] summary = ERROR
2019-03-21 12:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90896  13 58563 45398051 A  ERRORERROR'
2019-03-21 12:36:38 [DEBUG   ] Got command RPT from MCS: ref #90898
2019-03-21 12:36:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90898  77 58563 45398243 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:36:38 [DEBUG   ] Got command RPT from MCS: ref #90899
2019-03-21 12:36:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 12:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90899  12 58563 45398447 A  ERRORB—™š'
2019-03-21 12:36:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:37:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:37:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 12:37:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:37:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:37:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:37:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:37:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:37:10 [DEBUG   ] Finished updating board flags in 1.199 seconds
2019-03-21 12:37:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 12:37:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-21 12:37:40 [DEBUG   ] Got command RPT from MCS: ref #90904
2019-03-21 12:37:40 [DEBUG   ] summary = ERROR
2019-03-21 12:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90904  13 58563 45460739 A  ERRORERROR'
2019-03-21 12:37:40 [DEBUG   ] Got command RPT from MCS: ref #90905
2019-03-21 12:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90905  77 58563 45460739 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:37:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:38:11 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2019-03-21 12:38:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:38:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:38:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:38:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:38:11 [DEBUG   ] Finished updating board flags in 2.022 seconds
2019-03-21 12:38:31 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2019-03-21 12:38:51 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 12:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:39:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:39:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:39:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:39:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:39:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:39:10 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-03-21 12:39:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:39:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 12:39:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 12:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:40:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:40:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:40:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:40:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:40:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:40:10 [DEBUG   ] Finished updating board flags in 1.238 seconds
2019-03-21 12:40:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:40:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:40:52 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 12:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:41:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:41:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:41:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:41:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:41:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:41:10 [DEBUG   ] Finished updating board flags in 1.160 seconds
2019-03-21 12:41:12 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 12:41:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:41:37 [DEBUG   ] Got command RPT from MCS: ref #90927
2019-03-21 12:41:37 [DEBUG   ] summary = ERROR
2019-03-21 12:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90927  13 58563 45697735 A  ERRORERROR'
2019-03-21 12:41:37 [DEBUG   ] Got command RPT from MCS: ref #90928
2019-03-21 12:41:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90928  77 58563 45697927 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:41:38 [DEBUG   ] Got command RPT from MCS: ref #90929
2019-03-21 12:41:38 [DEBUG   ] summary = ERROR
2019-03-21 12:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90929  13 58563 45698131 A  ERRORERROR'
2019-03-21 12:41:38 [DEBUG   ] Got command RPT from MCS: ref #90930
2019-03-21 12:41:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90930  77 58563 45698335 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:41:38 [DEBUG   ] Got command RPT from MCS: ref #90931
2019-03-21 12:41:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 12:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90931  12 58563 45698539 A  ERRORB–™š'
2019-03-21 12:41:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 12:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:42:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:42:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:42:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:42:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:42:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:42:10 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-03-21 12:42:13 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 12:42:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:42:40 [DEBUG   ] Got command RPT from MCS: ref #90938
2019-03-21 12:42:40 [DEBUG   ] summary = ERROR
2019-03-21 12:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90938  13 58563 45760743 A  ERRORERROR'
2019-03-21 12:42:40 [DEBUG   ] Got command RPT from MCS: ref #90939
2019-03-21 12:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90939  77 58563 45760743 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:42:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 12:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:43:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:43:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:43:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:43:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:43:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:43:10 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-03-21 12:43:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 12:43:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 12:43:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:44:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:44:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:44:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:44:10 [WARNING ] (13, 1, 'bot')
2019-03-21 12:44:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:44:10 [DEBUG   ] Finished updating board flags in 0.965 seconds
2019-03-21 12:44:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:44:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:44:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:45:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:45:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:45:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:45:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:45:11 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-03-21 12:45:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 12:45:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:45:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:46:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 12:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:46:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:46:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:46:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:46:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:46:11 [DEBUG   ] Finished updating board flags in 1.212 seconds
2019-03-21 12:46:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:46:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:46:37 [DEBUG   ] Got command RPT from MCS: ref #90963
2019-03-21 12:46:37 [DEBUG   ] summary = ERROR
2019-03-21 12:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90963  13 58563 45997819 A  ERRORERROR'
2019-03-21 12:46:38 [DEBUG   ] Got command RPT from MCS: ref #90964
2019-03-21 12:46:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90964  77 58563 45998023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:46:38 [DEBUG   ] Got command RPT from MCS: ref #90965
2019-03-21 12:46:38 [DEBUG   ] summary = ERROR
2019-03-21 12:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90965  13 58563 45998215 A  ERRORERROR'
2019-03-21 12:46:38 [DEBUG   ] Got command RPT from MCS: ref #90967
2019-03-21 12:46:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90967  77 58563 45998419 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:46:38 [DEBUG   ] Got command RPT from MCS: ref #90968
2019-03-21 12:46:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 12:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90968  12 58563 45998623 A  ERRORB•™š'
2019-03-21 12:46:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 12:47:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:47:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:47:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:47:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:47:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:47:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:47:11 [DEBUG   ] Finished updating board flags in 1.181 seconds
2019-03-21 12:47:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 12:47:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:47:40 [DEBUG   ] Got command RPT from MCS: ref #90979
2019-03-21 12:47:40 [DEBUG   ] summary = ERROR
2019-03-21 12:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90979  13 58563 46060743 A  ERRORERROR'
2019-03-21 12:47:40 [DEBUG   ] Got command RPT from MCS: ref #90980
2019-03-21 12:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    90980  77 58563 46060743 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:47:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:48:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:48:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:48:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:48:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:48:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:48:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:48:11 [DEBUG   ] Finished updating board flags in 0.990 seconds
2019-03-21 12:48:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:48:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:48:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 12:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:49:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:49:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:49:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:49:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:49:12 [DEBUG   ] Finished updating board flags in 1.867 seconds
2019-03-21 12:49:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 12:49:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:49:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:50:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:50:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:50:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:50:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:50:12 [DEBUG   ] Finished updating board flags in 1.742 seconds
2019-03-21 12:50:14 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 12:50:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:50:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 12:51:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 12:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:51:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:51:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:51:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:51:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:51:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:51:11 [DEBUG   ] Finished updating board flags in 1.052 seconds
2019-03-21 12:51:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:51:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 12:51:37 [DEBUG   ] Got command RPT from MCS: ref #91002
2019-03-21 12:51:37 [DEBUG   ] summary = ERROR
2019-03-21 12:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91002  13 58563 46297903 A  ERRORERROR'
2019-03-21 12:51:38 [DEBUG   ] Got command RPT from MCS: ref #91003
2019-03-21 12:51:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91003  77 58563 46298107 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:51:38 [DEBUG   ] Got command RPT from MCS: ref #91004
2019-03-21 12:51:38 [DEBUG   ] summary = ERROR
2019-03-21 12:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91004  13 58563 46298299 A  ERRORERROR'
2019-03-21 12:51:38 [DEBUG   ] Got command RPT from MCS: ref #91005
2019-03-21 12:51:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91005  77 58563 46298503 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:51:38 [DEBUG   ] Got command RPT from MCS: ref #91006
2019-03-21 12:51:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 12:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91006  12 58563 46298707 A  ERRORB–™š'
2019-03-21 12:51:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 12:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:52:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:52:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:52:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:52:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:52:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:52:11 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-03-21 12:52:15 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 12:52:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:52:40 [DEBUG   ] Got command RPT from MCS: ref #91007
2019-03-21 12:52:40 [DEBUG   ] summary = ERROR
2019-03-21 12:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91007  13 58563 46360747 A  ERRORERROR'
2019-03-21 12:52:40 [DEBUG   ] Got command RPT from MCS: ref #91008
2019-03-21 12:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91008  77 58563 46360747 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:52:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:53:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:53:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:53:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:53:11 [WARNING ] (13, 1, 'bot')
2019-03-21 12:53:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:53:11 [DEBUG   ] Finished updating board flags in 0.966 seconds
2019-03-21 12:53:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:53:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:53:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:54:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 12:54:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:54:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:54:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:54:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:54:12 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-03-21 12:54:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:54:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:54:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 12:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:55:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:55:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:55:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:55:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:55:12 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-03-21 12:55:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:55:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:55:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:56:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:56:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:56:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:56:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:56:12 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-03-21 12:56:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:56:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:56:37 [DEBUG   ] Got command RPT from MCS: ref #91040
2019-03-21 12:56:37 [DEBUG   ] summary = ERROR
2019-03-21 12:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91040  13 58563 46597983 A  ERRORERROR'
2019-03-21 12:56:38 [DEBUG   ] Got command RPT from MCS: ref #91041
2019-03-21 12:56:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91041  77 58563 46598187 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:56:38 [DEBUG   ] Got command RPT from MCS: ref #91042
2019-03-21 12:56:38 [DEBUG   ] summary = ERROR
2019-03-21 12:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91042  13 58563 46598391 A  ERRORERROR'
2019-03-21 12:56:38 [DEBUG   ] Got command RPT from MCS: ref #91043
2019-03-21 12:56:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91043  77 58563 46598583 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:56:38 [DEBUG   ] Got command RPT from MCS: ref #91045
2019-03-21 12:56:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 12:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91045  12 58563 46598787 A  ERRORB–™š'
2019-03-21 12:56:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:57:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:57:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:57:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:57:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:57:12 [DEBUG   ] Finished updating board flags in 1.075 seconds
2019-03-21 12:57:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 12:57:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:57:40 [DEBUG   ] Got command RPT from MCS: ref #91056
2019-03-21 12:57:40 [DEBUG   ] summary = ERROR
2019-03-21 12:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91056  13 58563 46660751 A  ERRORERROR'
2019-03-21 12:57:40 [DEBUG   ] Got command RPT from MCS: ref #91057
2019-03-21 12:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 12:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91057  77 58563 46660751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 12:57:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:58:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 12:58:13 [WARNING ] (13, 1, 'bot')
2019-03-21 12:58:13 [WARNING ] (13, 1, 'bot')
2019-03-21 12:58:13 [WARNING ] (13, 1, 'bot')
2019-03-21 12:58:13 [WARNING ] (13, 1, 'bot')
2019-03-21 12:58:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:58:13 [DEBUG   ] Finished updating board flags in 1.962 seconds
2019-03-21 12:58:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:58:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:58:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 12:59:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:59:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:59:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:59:12 [WARNING ] (13, 1, 'bot')
2019-03-21 12:59:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 12:59:12 [DEBUG   ] Finished updating board flags in 1.226 seconds
2019-03-21 12:59:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:59:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 12:59:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:00:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:00:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:00:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:00:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:00:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:00:13 [DEBUG   ] Finished updating board flags in 1.773 seconds
2019-03-21 13:00:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:00:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:00:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:01:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:01:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:01:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:01:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:01:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:01:13 [DEBUG   ] Finished updating board flags in 1.553 seconds
2019-03-21 13:01:15 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 13:01:35 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:01:38 [DEBUG   ] Got command RPT from MCS: ref #91084
2019-03-21 13:01:38 [DEBUG   ] summary = ERROR
2019-03-21 13:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91084  13 58563 46898071 A  ERRORERROR'
2019-03-21 13:01:38 [DEBUG   ] Got command RPT from MCS: ref #91085
2019-03-21 13:01:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91085  77 58563 46898275 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:01:38 [DEBUG   ] Got command RPT from MCS: ref #91086
2019-03-21 13:01:38 [DEBUG   ] summary = ERROR
2019-03-21 13:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91086  13 58563 46898479 A  ERRORERROR'
2019-03-21 13:01:38 [DEBUG   ] Got command RPT from MCS: ref #91087
2019-03-21 13:01:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91087  77 58563 46898671 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:01:38 [DEBUG   ] Got command RPT from MCS: ref #91088
2019-03-21 13:01:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91088  12 58563 46898875 A  ERRORB–™š'
2019-03-21 13:01:55 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:02:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:02:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:02:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:02:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:02:13 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-03-21 13:02:15 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:02:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:02:40 [DEBUG   ] Got command RPT from MCS: ref #91095
2019-03-21 13:02:40 [DEBUG   ] summary = ERROR
2019-03-21 13:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91095  13 58563 46960751 A  ERRORERROR'
2019-03-21 13:02:40 [DEBUG   ] Got command RPT from MCS: ref #91096
2019-03-21 13:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91096  77 58563 46960751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:02:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 13:03:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 13:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:03:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:03:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:03:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:03:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:03:13 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-03-21 13:03:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:03:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:03:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 13:04:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 13:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:04:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:04:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:04:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:04:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:04:13 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-03-21 13:04:16 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 13:04:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 13:04:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:05:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:05:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:05:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:05:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:05:13 [DEBUG   ] Finished updating board flags in 1.190 seconds
2019-03-21 13:05:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 13:05:36 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:05:56 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:06:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:06:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:06:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:06:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:06:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:06:13 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-03-21 13:06:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:06:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:06:38 [DEBUG   ] Got command RPT from MCS: ref #91120
2019-03-21 13:06:38 [DEBUG   ] summary = ERROR
2019-03-21 13:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91120  13 58563 47198159 A  ERRORERROR'
2019-03-21 13:06:38 [DEBUG   ] Got command RPT from MCS: ref #91121
2019-03-21 13:06:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91121  77 58563 47198363 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:06:38 [DEBUG   ] Got command RPT from MCS: ref #91122
2019-03-21 13:06:38 [DEBUG   ] summary = ERROR
2019-03-21 13:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91122  13 58563 47198555 A  ERRORERROR'
2019-03-21 13:06:38 [DEBUG   ] Got command RPT from MCS: ref #91124
2019-03-21 13:06:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91124  77 58563 47198759 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:06:38 [DEBUG   ] Got command RPT from MCS: ref #91126
2019-03-21 13:06:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91126  12 58563 47198963 A  ERRORB–™š'
2019-03-21 13:06:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:07:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 13:07:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:07:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:07:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:07:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:07:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:07:14 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-03-21 13:07:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:07:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 13:07:40 [DEBUG   ] Got command RPT from MCS: ref #91130
2019-03-21 13:07:40 [DEBUG   ] summary = ERROR
2019-03-21 13:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91130  13 58563 47260751 A  ERRORERROR'
2019-03-21 13:07:40 [DEBUG   ] Got command RPT from MCS: ref #91131
2019-03-21 13:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91131  77 58563 47260751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:07:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 13:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:08:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:08:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:08:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:08:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:08:13 [DEBUG   ] Finished updating board flags in 0.995 seconds
2019-03-21 13:08:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:08:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:08:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 13:09:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:09:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:09:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:09:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:09:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:09:13 [DEBUG   ] Finished updating board flags in 1.272 seconds
2019-03-21 13:09:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:09:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:09:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:10:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:10:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:10:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:10:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:10:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:10:13 [DEBUG   ] Finished updating board flags in 1.174 seconds
2019-03-21 13:10:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:10:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:10:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 13:11:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:11:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:11:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:11:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:11:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:11:13 [DEBUG   ] Finished updating board flags in 1.033 seconds
2019-03-21 13:11:17 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:11:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:11:38 [DEBUG   ] Got command RPT from MCS: ref #91153
2019-03-21 13:11:38 [DEBUG   ] summary = ERROR
2019-03-21 13:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91153  13 58563 47498247 A  ERRORERROR'
2019-03-21 13:11:38 [DEBUG   ] Got command RPT from MCS: ref #91154
2019-03-21 13:11:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91154  77 58563 47498451 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:11:38 [DEBUG   ] Got command RPT from MCS: ref #91155
2019-03-21 13:11:38 [DEBUG   ] summary = ERROR
2019-03-21 13:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91155  13 58563 47498643 A  ERRORERROR'
2019-03-21 13:11:38 [DEBUG   ] Got command RPT from MCS: ref #91156
2019-03-21 13:11:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91156  77 58563 47498847 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:11:39 [DEBUG   ] Got command RPT from MCS: ref #91157
2019-03-21 13:11:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91157  12 58563 47499051 A  ERRORB–™š'
2019-03-21 13:11:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:12:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:12:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:12:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:12:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:12:13 [WARNING ] (13, 1, 'bot')
2019-03-21 13:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:12:13 [DEBUG   ] Finished updating board flags in 0.966 seconds
2019-03-21 13:12:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:12:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:12:40 [DEBUG   ] Got command RPT from MCS: ref #91164
2019-03-21 13:12:40 [DEBUG   ] summary = ERROR
2019-03-21 13:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91164  13 58563 47560751 A  ERRORERROR'
2019-03-21 13:12:40 [DEBUG   ] Got command RPT from MCS: ref #91165
2019-03-21 13:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91165  77 58563 47560751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:12:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:13:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:13:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:13:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:13:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:13:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:13:14 [DEBUG   ] Finished updating board flags in 1.379 seconds
2019-03-21 13:13:18 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 13:13:38 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 13:13:58 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:14:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:14:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:14:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:14:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:14:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:14:14 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-03-21 13:14:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 13:14:39 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 13:14:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:15:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:15:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:15:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:15:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:15:14 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-03-21 13:15:19 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 13:15:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:15:59 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-21 13:16:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 13:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:16:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:16:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:16:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:16:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:16:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:16:14 [DEBUG   ] Finished updating board flags in 0.983 seconds
2019-03-21 13:16:19 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:16:38 [DEBUG   ] Got command RPT from MCS: ref #91189
2019-03-21 13:16:38 [DEBUG   ] summary = ERROR
2019-03-21 13:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91189  13 58563 47798335 A  ERRORERROR'
2019-03-21 13:16:38 [DEBUG   ] Got command RPT from MCS: ref #91190
2019-03-21 13:16:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91190  77 58563 47798527 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:16:38 [DEBUG   ] Got command RPT from MCS: ref #91191
2019-03-21 13:16:38 [DEBUG   ] summary = ERROR
2019-03-21 13:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91191  13 58563 47798731 A  ERRORERROR'
2019-03-21 13:16:38 [DEBUG   ] Got command RPT from MCS: ref #91193
2019-03-21 13:16:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91193  77 58563 47798931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:16:39 [DEBUG   ] Got command RPT from MCS: ref #91195
2019-03-21 13:16:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91195  12 58563 47799135 A  ERRORB–™š'
2019-03-21 13:16:39 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 13:17:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 13:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:17:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:17:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:17:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:17:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:17:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:17:14 [DEBUG   ] Finished updating board flags in 1.286 seconds
2019-03-21 13:17:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:17:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:17:40 [DEBUG   ] Got command RPT from MCS: ref #91204
2019-03-21 13:17:40 [DEBUG   ] summary = ERROR
2019-03-21 13:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91204  13 58563 47860751 A  ERRORERROR'
2019-03-21 13:17:40 [DEBUG   ] Got command RPT from MCS: ref #91205
2019-03-21 13:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91205  77 58563 47860751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:18:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:18:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:18:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:18:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:18:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:18:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:18:14 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-03-21 13:18:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:18:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:19:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:19:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 13:19:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:19:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:19:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:19:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:19:14 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-03-21 13:19:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:19:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:20:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:20:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:20:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:20:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:20:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:20:14 [WARNING ] (13, 1, 'bot')
2019-03-21 13:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:20:14 [DEBUG   ] Finished updating board flags in 0.964 seconds
2019-03-21 13:20:20 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 13:20:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:21:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 13:21:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:21:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:21:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:21:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:21:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:21:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:21:15 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-03-21 13:21:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:21:38 [DEBUG   ] Got command RPT from MCS: ref #91228
2019-03-21 13:21:38 [DEBUG   ] summary = ERROR
2019-03-21 13:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91228  13 58563 48098411 A  ERRORERROR'
2019-03-21 13:21:38 [DEBUG   ] Got command RPT from MCS: ref #91229
2019-03-21 13:21:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91229  77 58563 48098615 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:21:38 [DEBUG   ] Got command RPT from MCS: ref #91230
2019-03-21 13:21:38 [DEBUG   ] summary = ERROR
2019-03-21 13:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91230  13 58563 48098819 A  ERRORERROR'
2019-03-21 13:21:39 [DEBUG   ] Got command RPT from MCS: ref #91231
2019-03-21 13:21:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91231  77 58563 48099023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:21:39 [DEBUG   ] Got command RPT from MCS: ref #91232
2019-03-21 13:21:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91232  12 58563 48099215 A  ERRORB–™š'
2019-03-21 13:21:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:22:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 13:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:22:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:22:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:22:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:22:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:22:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:22:15 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-03-21 13:22:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:22:40 [DEBUG   ] Got command RPT from MCS: ref #91233
2019-03-21 13:22:40 [DEBUG   ] summary = ERROR
2019-03-21 13:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91233  13 58563 48160759 A  ERRORERROR'
2019-03-21 13:22:40 [DEBUG   ] Got command RPT from MCS: ref #91234
2019-03-21 13:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91234  77 58563 48160759 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:22:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 13:23:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-21 13:23:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:23:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:23:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:23:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:23:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:23:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:23:15 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-03-21 13:23:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:23:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:24:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 13:24:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:24:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:24:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:24:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:24:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:24:15 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-03-21 13:24:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:24:41 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:25:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 13:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:25:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:25:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:25:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:25:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:25:16 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-03-21 13:25:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:25:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:26:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:26:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:26:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:26:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:26:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:26:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:26:15 [DEBUG   ] Finished updating board flags in 1.228 seconds
2019-03-21 13:26:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:26:38 [DEBUG   ] Got command RPT from MCS: ref #91258
2019-03-21 13:26:38 [DEBUG   ] summary = ERROR
2019-03-21 13:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91258  13 58563 48398503 A  ERRORERROR'
2019-03-21 13:26:38 [DEBUG   ] Got command RPT from MCS: ref #91259
2019-03-21 13:26:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91259  77 58563 48398707 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:26:38 [DEBUG   ] Got command RPT from MCS: ref #91260
2019-03-21 13:26:38 [DEBUG   ] summary = ERROR
2019-03-21 13:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91260  13 58563 48398899 A  ERRORERROR'
2019-03-21 13:26:39 [DEBUG   ] Got command RPT from MCS: ref #91262
2019-03-21 13:26:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91262  77 58563 48399103 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:26:39 [DEBUG   ] Got command RPT from MCS: ref #91263
2019-03-21 13:26:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91263  12 58563 48399308 A  ERRORB–™š'
2019-03-21 13:26:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:27:02 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:27:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:27:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:27:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:27:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:27:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:27:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:27:15 [DEBUG   ] Finished updating board flags in 1.233 seconds
2019-03-21 13:27:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:27:40 [DEBUG   ] Got command RPT from MCS: ref #91274
2019-03-21 13:27:40 [DEBUG   ] summary = ERROR
2019-03-21 13:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91274  13 58563 48460755 A  ERRORERROR'
2019-03-21 13:27:40 [DEBUG   ] Got command RPT from MCS: ref #91275
2019-03-21 13:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91275  77 58563 48460755 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:27:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 13:28:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 13:28:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:28:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:28:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:28:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:28:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:28:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:28:15 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-03-21 13:28:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:28:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:29:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 13:29:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:29:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:29:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:29:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:29:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:29:15 [DEBUG   ] Finished updating board flags in 1.041 seconds
2019-03-21 13:29:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:29:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:30:03 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 13:30:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:30:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:30:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:30:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:30:15 [WARNING ] (13, 1, 'bot')
2019-03-21 13:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:30:15 [DEBUG   ] Finished updating board flags in 0.965 seconds
2019-03-21 13:30:23 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 13:30:44 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 13:31:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:31:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:31:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:31:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:31:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:31:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:31:16 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-03-21 13:31:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:31:38 [DEBUG   ] Got command RPT from MCS: ref #91297
2019-03-21 13:31:38 [DEBUG   ] summary = ERROR
2019-03-21 13:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91297  13 58563 48698587 A  ERRORERROR'
2019-03-21 13:31:38 [DEBUG   ] Got command RPT from MCS: ref #91298
2019-03-21 13:31:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91298  77 58563 48698791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:31:38 [DEBUG   ] Got command RPT from MCS: ref #91299
2019-03-21 13:31:38 [DEBUG   ] summary = ERROR
2019-03-21 13:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91299  13 58563 48698995 A  ERRORERROR'
2019-03-21 13:31:39 [DEBUG   ] Got command RPT from MCS: ref #91300
2019-03-21 13:31:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91300  77 58563 48699187 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:31:39 [DEBUG   ] Got command RPT from MCS: ref #91301
2019-03-21 13:31:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91301  12 58563 48699391 A  ERRORB–™š'
2019-03-21 13:31:44 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 13:32:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 13:32:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:32:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:32:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:32:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:32:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:32:16 [DEBUG   ] Finished updating board flags in 1.186 seconds
2019-03-21 13:32:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:32:40 [DEBUG   ] Got command RPT from MCS: ref #91306
2019-03-21 13:32:40 [DEBUG   ] summary = ERROR
2019-03-21 13:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91306  13 58563 48760759 A  ERRORERROR'
2019-03-21 13:32:40 [DEBUG   ] Got command RPT from MCS: ref #91307
2019-03-21 13:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91307  77 58563 48760759 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:32:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:33:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:33:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:33:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:33:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:33:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:33:16 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-03-21 13:33:24 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 13:33:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:34:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:34:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:34:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:34:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:34:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:34:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:34:16 [DEBUG   ] Finished updating board flags in 0.982 seconds
2019-03-21 13:34:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:34:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:35:05 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 13:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:35:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:35:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:35:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:35:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:35:16 [DEBUG   ] Finished updating board flags in 1.284 seconds
2019-03-21 13:35:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:35:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:36:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:36:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:36:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:36:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:36:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:36:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:36:16 [DEBUG   ] Finished updating board flags in 1.172 seconds
2019-03-21 13:36:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 13:36:38 [DEBUG   ] Got command RPT from MCS: ref #91333
2019-03-21 13:36:38 [DEBUG   ] summary = ERROR
2019-03-21 13:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91333  13 58563 48998675 A  ERRORERROR'
2019-03-21 13:36:38 [DEBUG   ] Got command RPT from MCS: ref #91334
2019-03-21 13:36:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91334  77 58563 48998879 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:36:39 [DEBUG   ] Got command RPT from MCS: ref #91335
2019-03-21 13:36:39 [DEBUG   ] summary = ERROR
2019-03-21 13:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91335  13 58563 48999083 A  ERRORERROR'
2019-03-21 13:36:39 [DEBUG   ] Got command RPT from MCS: ref #91337
2019-03-21 13:36:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91337  77 58563 48999275 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:36:39 [DEBUG   ] Got command RPT from MCS: ref #91338
2019-03-21 13:36:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91338  12 58563 48999479 A  ERRORB–™š'
2019-03-21 13:36:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 13:37:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:37:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:37:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:37:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:37:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:37:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:37:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:37:16 [DEBUG   ] Finished updating board flags in 1.032 seconds
2019-03-21 13:37:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:37:40 [DEBUG   ] Got command RPT from MCS: ref #91343
2019-03-21 13:37:40 [DEBUG   ] summary = ERROR
2019-03-21 13:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91343  13 58563 49060755 A  ERRORERROR'
2019-03-21 13:37:40 [DEBUG   ] Got command RPT from MCS: ref #91344
2019-03-21 13:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91344  77 58563 49060755 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:37:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:38:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 13:38:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:38:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:38:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:38:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:38:16 [WARNING ] (13, 1, 'bot')
2019-03-21 13:38:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:38:16 [DEBUG   ] Finished updating board flags in 0.968 seconds
2019-03-21 13:38:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:38:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-21 13:39:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:39:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:39:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:39:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:39:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:39:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:39:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:39:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:39:17 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-03-21 13:39:26 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 13:39:46 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 13:40:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 13:40:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:40:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:40:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:40:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:40:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:40:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:40:17 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-03-21 13:40:26 [DEBUG   ] Finished updating ant stats in 0.388 seconds
2019-03-21 13:40:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:41:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 13:41:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:41:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:41:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:41:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:41:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:41:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:41:17 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-03-21 13:41:27 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 13:41:38 [DEBUG   ] Got command RPT from MCS: ref #91366
2019-03-21 13:41:38 [DEBUG   ] summary = ERROR
2019-03-21 13:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91366  13 58563 49298763 A  ERRORERROR'
2019-03-21 13:41:38 [DEBUG   ] Got command RPT from MCS: ref #91367
2019-03-21 13:41:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91367  77 58563 49298967 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:41:39 [DEBUG   ] Got command RPT from MCS: ref #91368
2019-03-21 13:41:39 [DEBUG   ] summary = ERROR
2019-03-21 13:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91368  13 58563 49299171 A  ERRORERROR'
2019-03-21 13:41:39 [DEBUG   ] Got command RPT from MCS: ref #91369
2019-03-21 13:41:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91369  77 58563 49299363 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:41:39 [DEBUG   ] Got command RPT from MCS: ref #91370
2019-03-21 13:41:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91370  12 58563 49299567 A  ERRORB–™š'
2019-03-21 13:41:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 13:42:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 13:42:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:42:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:42:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:42:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:42:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:42:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:42:17 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-03-21 13:42:27 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 13:42:40 [DEBUG   ] Got command RPT from MCS: ref #91377
2019-03-21 13:42:40 [DEBUG   ] summary = ERROR
2019-03-21 13:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91377  13 58563 49360759 A  ERRORERROR'
2019-03-21 13:42:40 [DEBUG   ] Got command RPT from MCS: ref #91378
2019-03-21 13:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91378  77 58563 49360759 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:42:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:43:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:43:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 13:43:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:43:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:43:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:43:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:43:17 [WARNING ] (13, 1, 'bot')
2019-03-21 13:43:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:43:17 [DEBUG   ] Finished updating board flags in 1.268 seconds
2019-03-21 13:43:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:43:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 13:44:00 [DEBUG   ] Got command TBN from MCS: ref #91394
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-03-21 13:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    91394   8 58563 49440827 A  ERROR'
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1553175842']
2019-03-21 13:44:00 [DEBUG   ] spawn_process: at 2019-03-21 13:44:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1553175842']
2019-03-21 13:44:00 [INFO    ] Finished spawning TBN in 0.056 s
2019-03-21 13:44:07 [DEBUG   ] Finished updating ant stats in 0.668 seconds
2019-03-21 13:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 13:44:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:44:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:44:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:44:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:44:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:44:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:44:18 [DEBUG   ] Finished updating board flags in 1.957 seconds
2019-03-21 13:44:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 13:44:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 13:45:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 13:45:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:45:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:45:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:45:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:45:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:45:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:45:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:45:18 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-03-21 13:45:27 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-03-21 13:45:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-21 13:46:08 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-21 13:46:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:46:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:46:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:46:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:46:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:46:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:46:18 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-03-21 13:46:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 13:46:38 [DEBUG   ] Got command RPT from MCS: ref #91403
2019-03-21 13:46:38 [DEBUG   ] summary = ERROR
2019-03-21 13:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91403  13 58563 49598851 A  ERRORERROR'
2019-03-21 13:46:39 [DEBUG   ] Got command RPT from MCS: ref #91404
2019-03-21 13:46:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91404  77 58563 49599055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:46:39 [DEBUG   ] Got command RPT from MCS: ref #91405
2019-03-21 13:46:39 [DEBUG   ] summary = ERROR
2019-03-21 13:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91405  13 58563 49599247 A  ERRORERROR'
2019-03-21 13:46:39 [DEBUG   ] Got command RPT from MCS: ref #91407
2019-03-21 13:46:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91407  77 58563 49599451 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:46:39 [DEBUG   ] Got command RPT from MCS: ref #91409
2019-03-21 13:46:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91409  12 58563 49599666 A  ERRORB–™š'
2019-03-21 13:46:48 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-21 13:47:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-21 13:47:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:47:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:47:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:47:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:47:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:47:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:47:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:47:18 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-03-21 13:47:28 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-21 13:47:40 [DEBUG   ] Got command RPT from MCS: ref #91416
2019-03-21 13:47:40 [DEBUG   ] summary = ERROR
2019-03-21 13:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91416  13 58563 49660755 A  ERRORERROR'
2019-03-21 13:47:40 [DEBUG   ] Got command RPT from MCS: ref #91417
2019-03-21 13:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91417  77 58563 49660755 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:47:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 13:48:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 13:48:11 [DEBUG   ] Got command TBW from MCS: ref #91437
2019-03-21 13:48:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-03-21 13:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    91437   8 58563 49691907 A  ERROR'
2019-03-21 13:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-03-21 13:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-03-21 13:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-03-21 13:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-03-21 13:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-03-21 13:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-03-21 13:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-03-21 13:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-03-21 13:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-03-21 13:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-03-21 13:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-03-21 13:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-03-21 13:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-03-21 13:48:15 [DEBUG   ] spawn_process: at 2019-03-21 13:48:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-03-21 13:48:15 [INFO    ] Finished spawning TBW
2019-03-21 13:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 13:48:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:48:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:48:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:48:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:48:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:48:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:48:18 [DEBUG   ] Finished updating board flags in 1.229 seconds
2019-03-21 13:49:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:49:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:49:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:49:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:49:18 [WARNING ] (13, 1, 'bot')
2019-03-21 13:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:49:18 [DEBUG   ] Finished updating board flags in 1.345 seconds
2019-03-21 13:50:03 [INFO    ] __waitForTBW - TBW finished in 108.529 s
2019-03-21 13:50:04 [DEBUG   ] Finished updating ant stats in 0.331 seconds
2019-03-21 13:50:04 [INFO    ] Started antennas statistics background thread
2019-03-21 13:50:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1553176206']
2019-03-21 13:50:04 [DEBUG   ] spawn_process: at 2019-03-21 13:50:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1553176206']
2019-03-21 13:50:04 [INFO    ] Finished spawning TBN in 0.054 s
2019-03-21 13:50:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:50:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:50:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:50:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:50:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:50:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:50:19 [DEBUG   ] Finished updating board flags in 1.643 seconds
2019-03-21 13:50:25 [DEBUG   ] Finished updating ant stats in 1.264 seconds
2019-03-21 13:50:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-21 13:51:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 13:51:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:51:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:51:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:51:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:51:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:51:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:51:19 [DEBUG   ] Finished updating board flags in 2.345 seconds
2019-03-21 13:51:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 13:51:38 [DEBUG   ] Got command RPT from MCS: ref #91451
2019-03-21 13:51:38 [DEBUG   ] summary = ERROR
2019-03-21 13:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91451  13 58563 49898943 A  ERRORERROR'
2019-03-21 13:51:39 [DEBUG   ] Got command RPT from MCS: ref #91452
2019-03-21 13:51:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91452  77 58563 49899135 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:51:39 [DEBUG   ] Got command RPT from MCS: ref #91453
2019-03-21 13:51:39 [DEBUG   ] summary = ERROR
2019-03-21 13:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91453  13 58563 49899339 A  ERRORERROR'
2019-03-21 13:51:39 [DEBUG   ] Got command RPT from MCS: ref #91454
2019-03-21 13:51:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91454  77 58563 49899543 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:51:39 [DEBUG   ] Got command RPT from MCS: ref #91455
2019-03-21 13:51:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91455  12 58563 49899735 A  ERRORB–™š'
2019-03-21 13:51:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-21 13:52:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 13:52:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:52:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:52:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:52:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:52:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:52:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:52:19 [DEBUG   ] Finished updating board flags in 2.051 seconds
2019-03-21 13:52:25 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-21 13:52:40 [DEBUG   ] Got command RPT from MCS: ref #91456
2019-03-21 13:52:40 [DEBUG   ] summary = ERROR
2019-03-21 13:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91456  13 58563 49960763 A  ERRORERROR'
2019-03-21 13:52:40 [DEBUG   ] Got command RPT from MCS: ref #91457
2019-03-21 13:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91457  77 58563 49960763 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:52:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:53:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-21 13:53:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 13:53:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:53:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:53:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:53:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:53:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:53:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:53:19 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-03-21 13:53:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 13:53:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 13:54:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 13:54:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:54:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 13:54:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:54:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:54:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:54:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:54:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:54:19 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-03-21 13:54:26 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-21 13:54:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-21 13:55:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-21 13:55:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:55:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:55:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:55:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:55:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:55:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:55:19 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-03-21 13:55:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 13:55:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 13:56:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 13:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 13:56:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:56:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:56:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:56:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:56:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:56:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:56:19 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-03-21 13:56:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 13:56:39 [DEBUG   ] Got command RPT from MCS: ref #91481
2019-03-21 13:56:39 [DEBUG   ] summary = ERROR
2019-03-21 13:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91481  13 58563 50199027 A  ERRORERROR'
2019-03-21 13:56:39 [DEBUG   ] Got command RPT from MCS: ref #91482
2019-03-21 13:56:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91482  77 58563 50199219 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:56:39 [DEBUG   ] Got command RPT from MCS: ref #91483
2019-03-21 13:56:39 [DEBUG   ] summary = ERROR
2019-03-21 13:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91483  13 58563 50199423 A  ERRORERROR'
2019-03-21 13:56:39 [DEBUG   ] Got command RPT from MCS: ref #91485
2019-03-21 13:56:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91485  77 58563 50199627 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:56:39 [DEBUG   ] Got command RPT from MCS: ref #91487
2019-03-21 13:56:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 13:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91487  12 58563 50199819 A  ERRORB–™š'
2019-03-21 13:56:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 13:57:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 13:57:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:57:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:57:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:57:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:57:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:57:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:57:19 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-03-21 13:57:26 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2019-03-21 13:57:40 [DEBUG   ] Got command RPT from MCS: ref #91497
2019-03-21 13:57:40 [DEBUG   ] summary = ERROR
2019-03-21 13:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91497  13 58563 50260767 A  ERRORERROR'
2019-03-21 13:57:40 [DEBUG   ] Got command RPT from MCS: ref #91498
2019-03-21 13:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 13:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91498  77 58563 50260767 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 13:57:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 13:58:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 13:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:58:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:58:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:58:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:58:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:58:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:58:19 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-03-21 13:58:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 13:58:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 13:59:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 13:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 13:59:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:59:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:59:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:59:19 [WARNING ] (13, 1, 'bot')
2019-03-21 13:59:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 13:59:19 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-03-21 13:59:26 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-21 13:59:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-03-21 14:00:07 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-03-21 14:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:00:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:00:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:00:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:00:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:00:19 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-03-21 14:00:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:00:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:01:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:01:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:01:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:01:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:01:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:01:19 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-03-21 14:01:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 14:01:39 [DEBUG   ] Got command RPT from MCS: ref #91520
2019-03-21 14:01:39 [DEBUG   ] summary = ERROR
2019-03-21 14:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91520  13 58563 50499107 A  ERRORERROR'
2019-03-21 14:01:39 [DEBUG   ] Got command RPT from MCS: ref #91521
2019-03-21 14:01:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91521  77 58563 50499311 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:01:39 [DEBUG   ] Got command RPT from MCS: ref #91522
2019-03-21 14:01:39 [DEBUG   ] summary = ERROR
2019-03-21 14:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91522  13 58563 50499515 A  ERRORERROR'
2019-03-21 14:01:39 [DEBUG   ] Got command RPT from MCS: ref #91523
2019-03-21 14:01:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91523  77 58563 50499707 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:01:39 [DEBUG   ] Got command RPT from MCS: ref #91524
2019-03-21 14:01:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91524  12 58563 50499911 A  ERRORB–™š'
2019-03-21 14:01:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-03-21 14:02:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:02:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:02:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 14:02:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:02:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:02:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:02:19 [WARNING ] (13, 1, 'bot')
2019-03-21 14:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:02:19 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-03-21 14:02:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 14:02:40 [DEBUG   ] Got command RPT from MCS: ref #91526
2019-03-21 14:02:40 [DEBUG   ] summary = ERROR
2019-03-21 14:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91526  13 58563 50560767 A  ERRORERROR'
2019-03-21 14:02:40 [DEBUG   ] Got command RPT from MCS: ref #91527
2019-03-21 14:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91527  77 58563 50560767 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:02:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-21 14:03:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 14:03:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:03:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:03:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:03:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:03:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:03:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:03:20 [DEBUG   ] Finished updating board flags in 2.044 seconds
2019-03-21 14:03:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 14:03:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 14:04:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 14:04:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:04:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:04:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:04:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:04:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:04:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:04:20 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-03-21 14:04:27 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-21 14:04:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:05:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 14:05:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:05:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:05:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:05:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:05:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:05:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:05:20 [DEBUG   ] Finished updating board flags in 1.934 seconds
2019-03-21 14:05:28 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-21 14:05:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-21 14:06:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-21 14:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:06:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:06:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:06:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:06:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:06:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:06:20 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-03-21 14:06:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-21 14:06:39 [DEBUG   ] Got command RPT from MCS: ref #91566
2019-03-21 14:06:39 [DEBUG   ] summary = ERROR
2019-03-21 14:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91566  13 58563 50799199 A  ERRORERROR'
2019-03-21 14:06:39 [DEBUG   ] Got command RPT from MCS: ref #91567
2019-03-21 14:06:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91567  77 58563 50799391 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:06:39 [DEBUG   ] Got command RPT from MCS: ref #91568
2019-03-21 14:06:39 [DEBUG   ] summary = ERROR
2019-03-21 14:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91568  13 58563 50799595 A  ERRORERROR'
2019-03-21 14:06:39 [DEBUG   ] Got command RPT from MCS: ref #91570
2019-03-21 14:06:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91570  77 58563 50799799 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:06:40 [DEBUG   ] Got command RPT from MCS: ref #91571
2019-03-21 14:06:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91571  12 58563 50800003 A  ERRORB•™š'
2019-03-21 14:06:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:07:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 14:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:07:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:07:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:07:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:07:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:07:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:07:20 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-03-21 14:07:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:07:40 [DEBUG   ] Got command RPT from MCS: ref #91576
2019-03-21 14:07:40 [DEBUG   ] summary = ERROR
2019-03-21 14:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91576  13 58563 50860763 A  ERRORERROR'
2019-03-21 14:07:40 [DEBUG   ] Got command RPT from MCS: ref #91577
2019-03-21 14:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91577  77 58563 50860763 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:07:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:08:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:08:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:08:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:08:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:08:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:08:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:08:20 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-03-21 14:08:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 14:08:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 14:09:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 14:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:09:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:09:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:09:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:09:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:09:20 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-03-21 14:09:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 14:09:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 14:10:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 14:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:10:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:10:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:10:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:10:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:10:20 [DEBUG   ] Finished updating board flags in 1.544 seconds
2019-03-21 14:10:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 14:10:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 14:11:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:11:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:11:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:11:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:11:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:11:20 [WARNING ] (13, 1, 'bot')
2019-03-21 14:11:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:11:20 [DEBUG   ] Finished updating board flags in 1.555 seconds
2019-03-21 14:11:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:11:39 [DEBUG   ] Got command RPT from MCS: ref #91599
2019-03-21 14:11:39 [DEBUG   ] summary = ERROR
2019-03-21 14:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91599  13 58563 51099279 A  ERRORERROR'
2019-03-21 14:11:39 [DEBUG   ] Got command RPT from MCS: ref #91600
2019-03-21 14:11:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91600  77 58563 51099483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:11:39 [DEBUG   ] Got command RPT from MCS: ref #91601
2019-03-21 14:11:39 [DEBUG   ] summary = ERROR
2019-03-21 14:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91601  13 58563 51099687 A  ERRORERROR'
2019-03-21 14:11:39 [DEBUG   ] Got command RPT from MCS: ref #91602
2019-03-21 14:11:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91602  77 58563 51099879 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:11:40 [DEBUG   ] Got command RPT from MCS: ref #91603
2019-03-21 14:11:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91603  12 58563 51100083 A  ERRORB–™š'
2019-03-21 14:11:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-21 14:12:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-21 14:12:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:12:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:12:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:12:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:12:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:12:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:12:21 [DEBUG   ] Finished updating board flags in 2.210 seconds
2019-03-21 14:12:29 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 14:12:40 [DEBUG   ] Got command RPT from MCS: ref #91610
2019-03-21 14:12:40 [DEBUG   ] summary = ERROR
2019-03-21 14:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91610  13 58563 51160763 A  ERRORERROR'
2019-03-21 14:12:40 [DEBUG   ] Got command RPT from MCS: ref #91611
2019-03-21 14:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91611  77 58563 51160763 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:12:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 14:13:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:13:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:13:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:13:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:13:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:13:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:13:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:13:21 [DEBUG   ] Finished updating board flags in 2.104 seconds
2019-03-21 14:13:29 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-21 14:13:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 14:14:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 14:14:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:14:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 14:14:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:14:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:14:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:14:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:14:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:14:21 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-03-21 14:14:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 14:14:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:15:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:15:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 14:15:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:15:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:15:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:15:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:15:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:15:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:15:21 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-03-21 14:15:30 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-21 14:15:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-21 14:16:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-21 14:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 14:16:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:16:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:16:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:16:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:16:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:16:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:16:21 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-03-21 14:16:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 14:16:39 [DEBUG   ] Got command RPT from MCS: ref #91635
2019-03-21 14:16:39 [DEBUG   ] summary = ERROR
2019-03-21 14:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91635  13 58563 51399363 A  ERRORERROR'
2019-03-21 14:16:39 [DEBUG   ] Got command RPT from MCS: ref #91636
2019-03-21 14:16:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91636  77 58563 51399567 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:16:39 [DEBUG   ] Got command RPT from MCS: ref #91637
2019-03-21 14:16:39 [DEBUG   ] summary = ERROR
2019-03-21 14:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91637  13 58563 51399771 A  ERRORERROR'
2019-03-21 14:16:39 [DEBUG   ] Got command RPT from MCS: ref #91639
2019-03-21 14:16:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91639  77 58563 51399975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:16:40 [DEBUG   ] Got command RPT from MCS: ref #91640
2019-03-21 14:16:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91640  12 58563 51400167 A  ERRORB–™š'
2019-03-21 14:16:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:17:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:17:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:17:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 14:17:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:17:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:17:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:17:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:17:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:17:21 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-03-21 14:17:30 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-21 14:17:40 [DEBUG   ] Got command RPT from MCS: ref #91645
2019-03-21 14:17:40 [DEBUG   ] summary = ERROR
2019-03-21 14:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91645  13 58563 51460763 A  ERRORERROR'
2019-03-21 14:17:40 [DEBUG   ] Got command RPT from MCS: ref #91646
2019-03-21 14:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91646  77 58563 51460763 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:17:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:18:10 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2019-03-21 14:18:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:18:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:18:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:18:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:18:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:18:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:18:21 [DEBUG   ] Finished updating board flags in 1.780 seconds
2019-03-21 14:18:30 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 14:18:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 14:19:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:19:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:19:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:19:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:19:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:19:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:19:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:19:21 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-03-21 14:19:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 14:19:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:20:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:20:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:20:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:20:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:20:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:20:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:20:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:20:21 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-03-21 14:20:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:20:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 14:21:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:21:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:21:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 14:21:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 14:21:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:21:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:21:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:21:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:21:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:21:21 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-03-21 14:21:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-21 14:21:39 [DEBUG   ] Got command RPT from MCS: ref #91674
2019-03-21 14:21:39 [DEBUG   ] summary = ERROR
2019-03-21 14:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91674  13 58563 51699459 A  ERRORERROR'
2019-03-21 14:21:39 [DEBUG   ] Got command RPT from MCS: ref #91675
2019-03-21 14:21:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91675  77 58563 51699651 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:21:39 [DEBUG   ] Got command RPT from MCS: ref #91676
2019-03-21 14:21:39 [DEBUG   ] summary = ERROR
2019-03-21 14:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91676  13 58563 51699855 A  ERRORERROR'
2019-03-21 14:21:40 [DEBUG   ] Got command RPT from MCS: ref #91677
2019-03-21 14:21:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91677  77 58563 51700059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:21:40 [DEBUG   ] Got command RPT from MCS: ref #91678
2019-03-21 14:21:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91678  12 58563 51700251 A  ERRORB–™š'
2019-03-21 14:21:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 14:22:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 14:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 14:22:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:22:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:22:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:22:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:22:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:22:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:22:21 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-03-21 14:22:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 14:22:40 [DEBUG   ] Got command RPT from MCS: ref #91679
2019-03-21 14:22:40 [DEBUG   ] summary = ERROR
2019-03-21 14:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91679  13 58563 51760771 A  ERRORERROR'
2019-03-21 14:22:40 [DEBUG   ] Got command RPT from MCS: ref #91680
2019-03-21 14:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91680  77 58563 51760771 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:22:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:23:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 14:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 14:23:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:23:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:23:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:23:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:23:21 [WARNING ] (13, 1, 'bot')
2019-03-21 14:23:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:23:21 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-03-21 14:23:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 14:23:51 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-21 14:24:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 14:24:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 14:24:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:24:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:24:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:24:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:24:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:24:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:24:22 [DEBUG   ] Finished updating board flags in 2.042 seconds
2019-03-21 14:24:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 14:24:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 14:25:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:25:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:25:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:25:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:25:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:25:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:25:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:25:22 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-03-21 14:25:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-21 14:25:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 14:26:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 14:26:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:26:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:26:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:26:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:26:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:26:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:26:22 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-03-21 14:26:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:26:39 [DEBUG   ] Got command RPT from MCS: ref #91704
2019-03-21 14:26:39 [DEBUG   ] summary = ERROR
2019-03-21 14:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91704  13 58563 51999535 A  ERRORERROR'
2019-03-21 14:26:39 [DEBUG   ] Got command RPT from MCS: ref #91705
2019-03-21 14:26:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91705  77 58563 51999739 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:26:39 [DEBUG   ] Got command RPT from MCS: ref #91706
2019-03-21 14:26:39 [DEBUG   ] summary = ERROR
2019-03-21 14:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91706  13 58563 51999943 A  ERRORERROR'
2019-03-21 14:26:40 [DEBUG   ] Got command RPT from MCS: ref #91708
2019-03-21 14:26:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91708  77 58563 52000147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:26:40 [DEBUG   ] Got command RPT from MCS: ref #91710
2019-03-21 14:26:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91710  12 58563 52000339 A  ERRORB–™š'
2019-03-21 14:26:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 14:27:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:27:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:27:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:27:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:27:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:27:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:27:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:27:22 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-03-21 14:27:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:27:40 [DEBUG   ] Got command RPT from MCS: ref #91720
2019-03-21 14:27:40 [DEBUG   ] summary = ERROR
2019-03-21 14:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91720  13 58563 52060767 A  ERRORERROR'
2019-03-21 14:27:40 [DEBUG   ] Got command RPT from MCS: ref #91721
2019-03-21 14:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91721  77 58563 52060767 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:27:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:28:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:28:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:28:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:28:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:28:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:28:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:28:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:28:22 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-03-21 14:28:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 14:28:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 14:29:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 14:29:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:29:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:29:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:29:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:29:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:29:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:29:22 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-03-21 14:29:32 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-21 14:29:53 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-21 14:30:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-21 14:30:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:30:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:30:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:30:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:30:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:30:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:30:22 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-03-21 14:30:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 14:30:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:31:13 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-21 14:31:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:31:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:31:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:31:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:31:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:31:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:31:22 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-03-21 14:31:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:31:39 [DEBUG   ] Got command RPT from MCS: ref #91743
2019-03-21 14:31:39 [DEBUG   ] summary = ERROR
2019-03-21 14:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91743  13 58563 52299619 A  ERRORERROR'
2019-03-21 14:31:39 [DEBUG   ] Got command RPT from MCS: ref #91744
2019-03-21 14:31:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91744  77 58563 52299823 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:31:40 [DEBUG   ] Got command RPT from MCS: ref #91745
2019-03-21 14:31:40 [DEBUG   ] summary = ERROR
2019-03-21 14:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91745  13 58563 52300027 A  ERRORERROR'
2019-03-21 14:31:40 [DEBUG   ] Got command RPT from MCS: ref #91746
2019-03-21 14:31:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91746  77 58563 52300231 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:31:40 [DEBUG   ] Got command RPT from MCS: ref #91747
2019-03-21 14:31:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91747  12 58563 52300423 A  ERRORB–™š'
2019-03-21 14:31:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:32:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 14:32:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:32:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:32:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:32:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:32:22 [WARNING ] (13, 1, 'bot')
2019-03-21 14:32:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:32:22 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-03-21 14:32:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 14:32:40 [DEBUG   ] Got command RPT from MCS: ref #91748
2019-03-21 14:32:40 [DEBUG   ] summary = ERROR
2019-03-21 14:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91748  13 58563 52360771 A  ERRORERROR'
2019-03-21 14:32:40 [DEBUG   ] Got command RPT from MCS: ref #91749
2019-03-21 14:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91749  77 58563 52360771 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:32:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 14:33:14 [DEBUG   ] Finished updating ant stats in 1.800 seconds
2019-03-21 14:33:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:33:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 14:33:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:33:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:33:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:33:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:33:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:33:23 [DEBUG   ] Finished updating board flags in 2.226 seconds
2019-03-21 14:33:33 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 14:33:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:34:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 14:34:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:34:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 14:34:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:34:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:34:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:34:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:34:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:34:23 [DEBUG   ] Finished updating board flags in 2.254 seconds
2019-03-21 14:34:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:34:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:35:14 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-21 14:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 14:35:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:35:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:35:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:35:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:35:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:35:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:35:23 [DEBUG   ] Finished updating board flags in 2.114 seconds
2019-03-21 14:35:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-21 14:35:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 14:36:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:36:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:36:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 14:36:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:36:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:36:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:36:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:36:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:36:23 [DEBUG   ] Finished updating board flags in 2.023 seconds
2019-03-21 14:36:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:36:39 [DEBUG   ] Got command RPT from MCS: ref #91779
2019-03-21 14:36:39 [DEBUG   ] summary = ERROR
2019-03-21 14:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91779  13 58563 52599715 A  ERRORERROR'
2019-03-21 14:36:39 [DEBUG   ] Got command RPT from MCS: ref #91780
2019-03-21 14:36:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91780  77 58563 52599907 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:36:40 [DEBUG   ] Got command RPT from MCS: ref #91781
2019-03-21 14:36:40 [DEBUG   ] summary = ERROR
2019-03-21 14:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91781  13 58563 52600111 A  ERRORERROR'
2019-03-21 14:36:40 [DEBUG   ] Got command RPT from MCS: ref #91782
2019-03-21 14:36:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91782  77 58563 52600315 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:36:40 [DEBUG   ] Got command RPT from MCS: ref #91784
2019-03-21 14:36:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91784  12 58563 52600507 A  ERRORB–™š'
2019-03-21 14:36:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:37:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:37:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:37:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:37:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:37:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:37:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:37:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:37:23 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-03-21 14:37:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:37:40 [DEBUG   ] Got command RPT from MCS: ref #91789
2019-03-21 14:37:40 [DEBUG   ] summary = ERROR
2019-03-21 14:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91789  13 58563 52660771 A  ERRORERROR'
2019-03-21 14:37:40 [DEBUG   ] Got command RPT from MCS: ref #91790
2019-03-21 14:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91790  77 58563 52660771 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:37:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:38:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 14:38:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:38:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:38:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:38:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:38:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:38:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:38:23 [DEBUG   ] Finished updating board flags in 1.848 seconds
2019-03-21 14:38:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 14:38:54 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-21 14:39:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:39:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:39:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:39:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:39:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:39:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:39:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:39:23 [DEBUG   ] Finished updating board flags in 1.756 seconds
2019-03-21 14:39:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:39:55 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-21 14:40:14 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-03-21 14:40:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:40:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:40:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:40:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:40:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:40:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:40:23 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-03-21 14:40:35 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-21 14:40:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-21 14:41:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:41:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:41:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 14:41:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:41:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:41:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:41:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:41:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:41:23 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-03-21 14:41:35 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-21 14:41:39 [DEBUG   ] Got command RPT from MCS: ref #91812
2019-03-21 14:41:39 [DEBUG   ] summary = ERROR
2019-03-21 14:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91812  13 58563 52899791 A  ERRORERROR'
2019-03-21 14:41:39 [DEBUG   ] Got command RPT from MCS: ref #91813
2019-03-21 14:41:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91813  77 58563 52899995 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:41:40 [DEBUG   ] Got command RPT from MCS: ref #91814
2019-03-21 14:41:40 [DEBUG   ] summary = ERROR
2019-03-21 14:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91814  13 58563 52900199 A  ERRORERROR'
2019-03-21 14:41:40 [DEBUG   ] Got command RPT from MCS: ref #91815
2019-03-21 14:41:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91815  77 58563 52900403 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:41:40 [DEBUG   ] Got command RPT from MCS: ref #91816
2019-03-21 14:41:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91816  12 58563 52900595 A  ERRORB–™š'
2019-03-21 14:41:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 14:42:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 14:42:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 14:42:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:42:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:42:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:42:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:42:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:42:23 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-03-21 14:42:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 14:42:40 [DEBUG   ] Got command RPT from MCS: ref #91823
2019-03-21 14:42:40 [DEBUG   ] summary = ERROR
2019-03-21 14:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91823  13 58563 52960775 A  ERRORERROR'
2019-03-21 14:42:40 [DEBUG   ] Got command RPT from MCS: ref #91824
2019-03-21 14:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91824  77 58563 52960775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:42:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 14:43:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 14:43:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:43:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 14:43:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:43:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:43:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:43:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:43:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:43:23 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-03-21 14:43:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:43:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 14:44:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:44:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 14:44:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:44:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:44:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:44:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:44:23 [WARNING ] (13, 1, 'bot')
2019-03-21 14:44:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:44:23 [DEBUG   ] Finished updating board flags in 1.372 seconds
2019-03-21 14:44:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:44:56 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-21 14:45:15 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-03-21 14:45:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 14:45:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:45:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:45:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:45:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:45:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:45:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:45:24 [DEBUG   ] Finished updating board flags in 2.042 seconds
2019-03-21 14:45:36 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-21 14:45:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-21 14:46:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:46:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:46:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:46:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:46:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:46:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:46:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:46:24 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-03-21 14:46:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 14:46:39 [DEBUG   ] Got command RPT from MCS: ref #91848
2019-03-21 14:46:39 [DEBUG   ] summary = ERROR
2019-03-21 14:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91848  13 58563 53199883 A  ERRORERROR'
2019-03-21 14:46:40 [DEBUG   ] Got command RPT from MCS: ref #91849
2019-03-21 14:46:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91849  77 58563 53200087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:46:40 [DEBUG   ] Got command RPT from MCS: ref #91850
2019-03-21 14:46:40 [DEBUG   ] summary = ERROR
2019-03-21 14:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91850  13 58563 53200279 A  ERRORERROR'
2019-03-21 14:46:40 [DEBUG   ] Got command RPT from MCS: ref #91852
2019-03-21 14:46:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91852  77 58563 53200483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:46:40 [DEBUG   ] Got command RPT from MCS: ref #91853
2019-03-21 14:46:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91853  12 58563 53200687 A  ERRORB–™š'
2019-03-21 14:46:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:47:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:47:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 14:47:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:47:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:47:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:47:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:47:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:47:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:47:24 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-03-21 14:47:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:47:40 [DEBUG   ] Got command RPT from MCS: ref #91858
2019-03-21 14:47:40 [DEBUG   ] summary = ERROR
2019-03-21 14:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91858  13 58563 53260775 A  ERRORERROR'
2019-03-21 14:47:40 [DEBUG   ] Got command RPT from MCS: ref #91859
2019-03-21 14:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91859  77 58563 53260775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:47:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 14:48:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:48:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:48:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 14:48:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:48:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:48:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:48:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:48:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:48:24 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-03-21 14:48:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:48:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:49:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:49:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 14:49:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:49:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 14:49:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-03-21 14:49:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:49:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:49:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:49:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:49:24 [WARNING ] (25, 5, 'bot')
2019-03-21 14:49:24 [WARNING ] (25, 5, 'bot')
2019-03-21 14:49:24 [WARNING ] (25, 5, 'bot')
2019-03-21 14:49:24 [WARNING ] (25, 5, 'bot')
2019-03-21 14:49:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:49:24 [DEBUG   ] Finished updating board flags in 1.773 seconds
2019-03-21 14:49:36 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 14:49:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 14:50:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-03-21 14:50:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:50:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:50:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:50:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:50:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:50:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:50:24 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-03-21 14:50:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:50:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 14:51:17 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-21 14:51:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:51:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:51:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:51:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:51:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:51:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:51:24 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-03-21 14:51:36 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-03-21 14:51:39 [DEBUG   ] Got command RPT from MCS: ref #91887
2019-03-21 14:51:39 [DEBUG   ] summary = ERROR
2019-03-21 14:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91887  13 58563 53499967 A  ERRORERROR'
2019-03-21 14:51:40 [DEBUG   ] Got command RPT from MCS: ref #91888
2019-03-21 14:51:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91888  77 58563 53500171 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:51:40 [DEBUG   ] Got command RPT from MCS: ref #91889
2019-03-21 14:51:40 [DEBUG   ] summary = ERROR
2019-03-21 14:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91889  13 58563 53500375 A  ERRORERROR'
2019-03-21 14:51:40 [DEBUG   ] Got command RPT from MCS: ref #91890
2019-03-21 14:51:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91890  77 58563 53500567 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:51:40 [DEBUG   ] Got command RPT from MCS: ref #91891
2019-03-21 14:51:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91891  12 58563 53500771 A  ERRORB–™š'
2019-03-21 14:51:57 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-21 14:52:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-21 14:52:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:52:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:52:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:52:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:52:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:52:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:52:24 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-03-21 14:52:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 14:52:40 [DEBUG   ] Got command RPT from MCS: ref #91892
2019-03-21 14:52:40 [DEBUG   ] summary = ERROR
2019-03-21 14:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91892  13 58563 53560775 A  ERRORERROR'
2019-03-21 14:52:40 [DEBUG   ] Got command RPT from MCS: ref #91893
2019-03-21 14:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91893  77 58563 53560775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:52:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 14:53:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:53:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:53:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:53:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:53:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:53:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:53:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:53:24 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-03-21 14:53:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:53:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:54:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 14:54:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:54:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:54:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:54:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:54:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:54:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:54:24 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-03-21 14:54:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 14:54:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 14:55:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 14:55:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:55:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:55:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:55:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:55:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:55:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:55:24 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-03-21 14:55:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 14:55:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 14:56:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 14:56:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 14:56:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:56:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 14:56:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:56:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:56:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:56:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:56:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:56:24 [DEBUG   ] Finished updating board flags in 1.432 seconds
2019-03-21 14:56:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 14:56:40 [DEBUG   ] Got command RPT from MCS: ref #91917
2019-03-21 14:56:40 [DEBUG   ] summary = ERROR
2019-03-21 14:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91917  13 58563 53800059 A  ERRORERROR'
2019-03-21 14:56:40 [DEBUG   ] Got command RPT from MCS: ref #91918
2019-03-21 14:56:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91918  77 58563 53800263 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:56:40 [DEBUG   ] Got command RPT from MCS: ref #91919
2019-03-21 14:56:40 [DEBUG   ] summary = ERROR
2019-03-21 14:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91919  13 58563 53800455 A  ERRORERROR'
2019-03-21 14:56:40 [DEBUG   ] Got command RPT from MCS: ref #91921
2019-03-21 14:56:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91921  77 58563 53800659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:56:40 [DEBUG   ] Got command RPT from MCS: ref #91922
2019-03-21 14:56:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 14:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91922  12 58563 53800863 A  ERRORB–™š'
2019-03-21 14:56:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 14:57:17 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 14:57:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:57:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:57:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:57:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:57:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:57:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:57:24 [DEBUG   ] Finished updating board flags in 1.443 seconds
2019-03-21 14:57:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-21 14:57:40 [DEBUG   ] Got command RPT from MCS: ref #91933
2019-03-21 14:57:40 [DEBUG   ] summary = ERROR
2019-03-21 14:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91933  13 58563 53860775 A  ERRORERROR'
2019-03-21 14:57:40 [DEBUG   ] Got command RPT from MCS: ref #91934
2019-03-21 14:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 14:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91934  77 58563 53860775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 14:57:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 14:58:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 14:58:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:58:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:58:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:58:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:58:24 [WARNING ] (13, 1, 'bot')
2019-03-21 14:58:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:58:24 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-03-21 14:58:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-03-21 14:58:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 14:59:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 14:59:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 14:59:25 [WARNING ] (13, 1, 'bot')
2019-03-21 14:59:25 [WARNING ] (13, 1, 'bot')
2019-03-21 14:59:25 [WARNING ] (13, 1, 'bot')
2019-03-21 14:59:25 [WARNING ] (13, 1, 'bot')
2019-03-21 14:59:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 14:59:25 [DEBUG   ] Finished updating board flags in 2.228 seconds
2019-03-21 14:59:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 14:59:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 15:00:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-03-21 15:00:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:00:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:00:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:00:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:00:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:00:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:00:25 [DEBUG   ] Finished updating board flags in 2.150 seconds
2019-03-21 15:00:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:00:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:01:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:01:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:01:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:01:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:01:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:01:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:01:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:01:25 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-03-21 15:01:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 15:01:40 [DEBUG   ] Got command RPT from MCS: ref #91956
2019-03-21 15:01:40 [DEBUG   ] summary = ERROR
2019-03-21 15:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91956  13 58563 54100147 A  ERRORERROR'
2019-03-21 15:01:40 [DEBUG   ] Got command RPT from MCS: ref #91957
2019-03-21 15:01:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91957  77 58563 54100351 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:01:40 [DEBUG   ] Got command RPT from MCS: ref #91958
2019-03-21 15:01:40 [DEBUG   ] summary = ERROR
2019-03-21 15:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91958  13 58563 54100543 A  ERRORERROR'
2019-03-21 15:01:40 [DEBUG   ] Got command RPT from MCS: ref #91959
2019-03-21 15:01:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91959  77 58563 54100747 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:01:40 [DEBUG   ] Got command RPT from MCS: ref #91960
2019-03-21 15:01:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91960  12 58563 54100951 A  ERRORB–™š'
2019-03-21 15:01:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:02:19 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-21 15:02:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 15:02:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:02:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:02:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:02:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:02:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:02:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:02:25 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-03-21 15:02:39 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-21 15:02:40 [DEBUG   ] Got command RPT from MCS: ref #91961
2019-03-21 15:02:40 [DEBUG   ] summary = ERROR
2019-03-21 15:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91961  13 58563 54160779 A  ERRORERROR'
2019-03-21 15:02:40 [DEBUG   ] Got command RPT from MCS: ref #91962
2019-03-21 15:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91962  77 58563 54160779 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:02:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-21 15:03:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 15:03:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:03:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:03:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:03:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:03:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:03:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:03:25 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-03-21 15:03:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 15:03:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 15:04:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 15:04:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:04:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:04:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:04:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:04:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:04:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:04:25 [DEBUG   ] Finished updating board flags in 1.864 seconds
2019-03-21 15:04:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-21 15:04:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 15:05:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 15:05:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:05:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 15:05:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:05:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:05:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:05:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:05:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:05:25 [DEBUG   ] Finished updating board flags in 1.733 seconds
2019-03-21 15:05:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 15:05:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 15:06:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 15:06:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:06:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 15:06:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:06:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:06:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:06:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:06:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:06:25 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-03-21 15:06:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 15:06:40 [DEBUG   ] Got command RPT from MCS: ref #91992
2019-03-21 15:06:40 [DEBUG   ] summary = ERROR
2019-03-21 15:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91992  13 58563 54400231 A  ERRORERROR'
2019-03-21 15:06:40 [DEBUG   ] Got command RPT from MCS: ref #91993
2019-03-21 15:06:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91993  77 58563 54400435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:06:40 [DEBUG   ] Got command RPT from MCS: ref #91994
2019-03-21 15:06:40 [DEBUG   ] summary = ERROR
2019-03-21 15:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91994  13 58563 54400639 A  ERRORERROR'
2019-03-21 15:06:40 [DEBUG   ] Got command RPT from MCS: ref #91996
2019-03-21 15:06:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91996  77 58563 54400831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:06:41 [DEBUG   ] Got command RPT from MCS: ref #91998
2019-03-21 15:06:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    91998  12 58563 54401035 A  ERRORB–™š'
2019-03-21 15:06:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 15:07:19 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-21 15:07:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:07:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:07:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:07:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:07:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:07:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:07:25 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-03-21 15:07:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 15:07:40 [DEBUG   ] Got command RPT from MCS: ref #92002
2019-03-21 15:07:40 [DEBUG   ] summary = ERROR
2019-03-21 15:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92002  13 58563 54460783 A  ERRORERROR'
2019-03-21 15:07:40 [DEBUG   ] Got command RPT from MCS: ref #92003
2019-03-21 15:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92003  77 58563 54460783 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:07:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:08:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:08:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:08:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:08:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:08:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:08:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:08:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:08:25 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-03-21 15:08:40 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-21 15:09:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-21 15:09:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-03-21 15:09:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:09:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 15:09:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:09:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:09:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:09:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:09:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:09:25 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-03-21 15:09:40 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-03-21 15:10:00 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-03-21 15:10:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 15:10:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:10:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:10:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:10:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:10:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:10:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:10:25 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-03-21 15:10:40 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 15:11:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 15:11:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 15:11:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:11:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:11:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:11:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:11:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:11:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:11:25 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-03-21 15:11:40 [DEBUG   ] Got command RPT from MCS: ref #92025
2019-03-21 15:11:40 [DEBUG   ] summary = ERROR
2019-03-21 15:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92025  13 58563 54700315 A  ERRORERROR'
2019-03-21 15:11:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 15:11:40 [DEBUG   ] Got command RPT from MCS: ref #92026
2019-03-21 15:11:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92026  77 58563 54700523 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:11:40 [DEBUG   ] Got command RPT from MCS: ref #92027
2019-03-21 15:11:40 [DEBUG   ] summary = ERROR
2019-03-21 15:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92027  13 58563 54700715 A  ERRORERROR'
2019-03-21 15:11:40 [DEBUG   ] Got command RPT from MCS: ref #92028
2019-03-21 15:11:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92028  77 58563 54700919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:11:41 [DEBUG   ] Got command RPT from MCS: ref #92029
2019-03-21 15:11:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92029  12 58563 54701123 A  ERRORB–™š'
2019-03-21 15:12:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 15:12:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 15:12:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:12:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:12:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:12:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:12:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:12:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:12:25 [DEBUG   ] Finished updating board flags in 1.439 seconds
2019-03-21 15:12:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 15:12:40 [DEBUG   ] Got command RPT from MCS: ref #92036
2019-03-21 15:12:40 [DEBUG   ] summary = ERROR
2019-03-21 15:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92036  13 58563 54760779 A  ERRORERROR'
2019-03-21 15:12:40 [DEBUG   ] Got command RPT from MCS: ref #92037
2019-03-21 15:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92037  77 58563 54760779 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:13:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 15:13:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 15:13:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:13:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:13:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:13:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:13:25 [WARNING ] (13, 1, 'bot')
2019-03-21 15:13:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:13:25 [DEBUG   ] Finished updating board flags in 1.555 seconds
2019-03-21 15:13:40 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2019-03-21 15:14:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 15:14:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:14:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:14:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:14:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:14:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:14:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:14:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:14:26 [DEBUG   ] Finished updating board flags in 2.257 seconds
2019-03-21 15:14:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:15:01 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-21 15:15:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-21 15:15:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:15:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 15:15:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:15:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:15:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:15:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:15:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:15:26 [DEBUG   ] Finished updating board flags in 2.207 seconds
2019-03-21 15:15:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:16:01 [DEBUG   ] Finished updating ant stats in 1.007 seconds
2019-03-21 15:16:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 15:16:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:16:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:16:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:16:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:16:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:16:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:16:26 [DEBUG   ] Finished updating board flags in 2.084 seconds
2019-03-21 15:16:40 [DEBUG   ] Got command RPT from MCS: ref #92061
2019-03-21 15:16:40 [DEBUG   ] summary = ERROR
2019-03-21 15:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92061  13 58563 55000399 A  ERRORERROR'
2019-03-21 15:16:40 [DEBUG   ] Got command RPT from MCS: ref #92062
2019-03-21 15:16:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92062  77 58563 55000603 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:16:40 [DEBUG   ] Got command RPT from MCS: ref #92063
2019-03-21 15:16:40 [DEBUG   ] summary = ERROR
2019-03-21 15:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92063  13 58563 55000807 A  ERRORERROR'
2019-03-21 15:16:40 [DEBUG   ] Got command RPT from MCS: ref #92065
2019-03-21 15:16:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92065  77 58563 55000999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:16:41 [DEBUG   ] Got command RPT from MCS: ref #92066
2019-03-21 15:16:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92066  12 58563 55001203 A  ERRORB–™š'
2019-03-21 15:16:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 15:17:01 [DEBUG   ] Finished updating ant stats in 1.072 seconds
2019-03-21 15:17:21 [DEBUG   ] Finished updating ant stats in 0.932 seconds
2019-03-21 15:17:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:17:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:17:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:17:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:17:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:17:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:17:26 [DEBUG   ] Finished updating board flags in 2.024 seconds
2019-03-21 15:17:40 [DEBUG   ] Got command RPT from MCS: ref #92071
2019-03-21 15:17:40 [DEBUG   ] summary = ERROR
2019-03-21 15:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92071  13 58563 55060783 A  ERRORERROR'
2019-03-21 15:17:40 [DEBUG   ] Got command RPT from MCS: ref #92072
2019-03-21 15:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92072  77 58563 55060783 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:17:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-21 15:18:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 15:18:21 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 15:18:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:18:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:18:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:18:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:18:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:18:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:18:26 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-03-21 15:18:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:19:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 15:19:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:19:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 15:19:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:19:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:19:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:19:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:19:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:19:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:19:26 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-03-21 15:19:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:20:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 15:20:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 15:20:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:20:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:20:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:20:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:20:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:20:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:20:26 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-03-21 15:20:41 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-21 15:21:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-21 15:21:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-21 15:21:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:21:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 15:21:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:21:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:21:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:21:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:21:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:21:26 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-03-21 15:21:40 [DEBUG   ] Got command RPT from MCS: ref #92100
2019-03-21 15:21:40 [DEBUG   ] summary = ERROR
2019-03-21 15:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92100  13 58563 55300487 A  ERRORERROR'
2019-03-21 15:21:40 [DEBUG   ] Got command RPT from MCS: ref #92101
2019-03-21 15:21:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92101  77 58563 55300691 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:21:40 [DEBUG   ] Got command RPT from MCS: ref #92102
2019-03-21 15:21:40 [DEBUG   ] summary = ERROR
2019-03-21 15:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92102  13 58563 55300883 A  ERRORERROR'
2019-03-21 15:21:41 [DEBUG   ] Got command RPT from MCS: ref #92103
2019-03-21 15:21:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92103  77 58563 55301087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:21:41 [DEBUG   ] Got command RPT from MCS: ref #92104
2019-03-21 15:21:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92104  12 58563 55301291 A  ERRORB–™š'
2019-03-21 15:21:42 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 15:22:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 15:22:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 15:22:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 15:22:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:22:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:22:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:22:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:22:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:22:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:22:26 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-03-21 15:22:40 [DEBUG   ] Got command RPT from MCS: ref #92105
2019-03-21 15:22:40 [DEBUG   ] summary = ERROR
2019-03-21 15:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92105  13 58563 55360775 A  ERRORERROR'
2019-03-21 15:22:40 [DEBUG   ] Got command RPT from MCS: ref #92106
2019-03-21 15:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92106  77 58563 55360775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:22:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 15:23:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 15:23:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 15:23:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:23:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:23:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:23:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:23:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:23:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:23:26 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-03-21 15:23:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 15:24:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 15:24:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:24:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:24:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:24:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:24:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:24:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:24:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:24:26 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-03-21 15:24:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:25:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:25:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 15:25:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:25:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:25:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:25:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:25:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:25:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:25:26 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-03-21 15:25:42 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 15:26:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-21 15:26:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-21 15:26:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:26:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:26:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:26:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:26:26 [WARNING ] (13, 1, 'bot')
2019-03-21 15:26:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:26:26 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-03-21 15:26:40 [DEBUG   ] Got command RPT from MCS: ref #92130
2019-03-21 15:26:40 [DEBUG   ] summary = ERROR
2019-03-21 15:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92130  13 58563 55600567 A  ERRORERROR'
2019-03-21 15:26:40 [DEBUG   ] Got command RPT from MCS: ref #92131
2019-03-21 15:26:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92131  77 58563 55600771 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:26:40 [DEBUG   ] Got command RPT from MCS: ref #92132
2019-03-21 15:26:40 [DEBUG   ] summary = ERROR
2019-03-21 15:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92132  13 58563 55600975 A  ERRORERROR'
2019-03-21 15:26:41 [DEBUG   ] Got command RPT from MCS: ref #92133
2019-03-21 15:26:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92133  77 58563 55601167 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:26:41 [DEBUG   ] Got command RPT from MCS: ref #92135
2019-03-21 15:26:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92135  12 58563 55601371 A  ERRORB–™š'
2019-03-21 15:26:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 15:27:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-21 15:27:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 15:27:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:27:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:27:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:27:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:27:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:27:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:27:27 [DEBUG   ] Finished updating board flags in 2.208 seconds
2019-03-21 15:27:40 [DEBUG   ] Got command RPT from MCS: ref #92146
2019-03-21 15:27:40 [DEBUG   ] summary = ERROR
2019-03-21 15:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92146  13 58563 55660779 A  ERRORERROR'
2019-03-21 15:27:40 [DEBUG   ] Got command RPT from MCS: ref #92147
2019-03-21 15:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92147  77 58563 55660779 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:27:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 15:28:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 15:28:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-21 15:28:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:28:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:28:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:28:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:28:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:28:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:28:27 [DEBUG   ] Finished updating board flags in 2.208 seconds
2019-03-21 15:28:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-03-21 15:29:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:29:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:29:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 15:29:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:29:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:29:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:29:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:29:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:29:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:29:27 [DEBUG   ] Finished updating board flags in 2.219 seconds
2019-03-21 15:29:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 15:30:04 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-21 15:30:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 15:30:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:30:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:30:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:30:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:30:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:30:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:30:27 [DEBUG   ] Finished updating board flags in 2.166 seconds
2019-03-21 15:30:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 15:31:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 15:31:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 15:31:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:31:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:31:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:31:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:31:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:31:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:31:27 [DEBUG   ] Finished updating board flags in 2.063 seconds
2019-03-21 15:31:40 [DEBUG   ] Got command RPT from MCS: ref #92169
2019-03-21 15:31:40 [DEBUG   ] summary = ERROR
2019-03-21 15:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92169  13 58563 55900655 A  ERRORERROR'
2019-03-21 15:31:40 [DEBUG   ] Got command RPT from MCS: ref #92170
2019-03-21 15:31:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92170  77 58563 55900859 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:31:41 [DEBUG   ] Got command RPT from MCS: ref #92171
2019-03-21 15:31:41 [DEBUG   ] summary = ERROR
2019-03-21 15:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92171  13 58563 55901063 A  ERRORERROR'
2019-03-21 15:31:41 [DEBUG   ] Got command RPT from MCS: ref #92172
2019-03-21 15:31:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92172  77 58563 55901255 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:31:41 [DEBUG   ] Got command RPT from MCS: ref #92173
2019-03-21 15:31:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92173  12 58563 55901459 A  ERRORB–™š'
2019-03-21 15:31:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:32:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 15:32:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 15:32:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:32:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:32:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:32:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:32:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:32:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:32:27 [DEBUG   ] Finished updating board flags in 1.947 seconds
2019-03-21 15:32:40 [DEBUG   ] Got command RPT from MCS: ref #92174
2019-03-21 15:32:40 [DEBUG   ] summary = ERROR
2019-03-21 15:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92174  13 58563 55960787 A  ERRORERROR'
2019-03-21 15:32:40 [DEBUG   ] Got command RPT from MCS: ref #92175
2019-03-21 15:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92175  77 58563 55960787 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:32:44 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-21 15:33:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 15:33:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-21 15:33:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 15:33:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:33:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:33:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:33:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:33:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:33:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:33:27 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-03-21 15:33:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 15:34:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:34:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:34:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:34:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:34:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:34:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:34:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:34:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:34:27 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-03-21 15:34:44 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-03-21 15:35:05 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-21 15:35:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 15:35:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 15:35:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:35:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:35:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:35:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:35:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:35:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:35:27 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-03-21 15:35:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-21 15:36:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 15:36:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 15:36:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:36:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:36:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:36:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:36:27 [WARNING ] (13, 1, 'bot')
2019-03-21 15:36:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:36:27 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-03-21 15:36:40 [DEBUG   ] Got command RPT from MCS: ref #92205
2019-03-21 15:36:40 [DEBUG   ] summary = ERROR
2019-03-21 15:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92205  13 58563 56200735 A  ERRORERROR'
2019-03-21 15:36:40 [DEBUG   ] Got command RPT from MCS: ref #92206
2019-03-21 15:36:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92206  77 58563 56200939 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:36:41 [DEBUG   ] Got command RPT from MCS: ref #92207
2019-03-21 15:36:41 [DEBUG   ] summary = ERROR
2019-03-21 15:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92207  13 58563 56201143 A  ERRORERROR'
2019-03-21 15:36:41 [DEBUG   ] Got command RPT from MCS: ref #92209
2019-03-21 15:36:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92209  77 58563 56201347 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:36:41 [DEBUG   ] Got command RPT from MCS: ref #92210
2019-03-21 15:36:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92210  12 58563 56201539 A  ERRORB–™š'
2019-03-21 15:36:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:37:00 [DEBUG   ] Got command RPT from MCS: ref #92215
2019-03-21 15:37:00 [DEBUG   ] summary = ERROR
2019-03-21 15:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92215  13 58563 56220743 A  ERRORERROR'
2019-03-21 15:37:00 [DEBUG   ] Got command RPT from MCS: ref #92216
2019-03-21 15:37:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92216  77 58563 56220743 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:37:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:37:05 [DEBUG   ] Got command INI from MCS: ref #92217
2019-03-21 15:37:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-03-21 15:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    92217   8 58563 56225751 ABOOTING'
2019-03-21 15:37:29 [INFO    ] -------------------
2019-03-21 15:37:29 [INFO    ]  LWA board status
2019-03-21 15:37:29 [INFO    ] -------------------
2019-03-21 15:37:29 [INFO    ] DP 1: 2 lwa27
2019-03-21 15:37:29 [INFO    ] DP 1: 3 lwa24
2019-03-21 15:37:29 [INFO    ] DP 1: 4 lwa23
2019-03-21 15:37:29 [INFO    ] DP 1: 5 lwa18
2019-03-21 15:37:29 [INFO    ] DP 1: 6 lwa10
2019-03-21 15:37:29 [INFO    ] DP 1: 7 lwa32
2019-03-21 15:37:29 [INFO    ] DP 1: 8 lwa11
2019-03-21 15:37:29 [INFO    ] DP 1: 9 lwa30
2019-03-21 15:37:29 [INFO    ] DP 1: 10 lwa12
2019-03-21 15:37:29 [INFO    ] DP 1: 11 lwa8
2019-03-21 15:37:29 [INFO    ] DP 1: 12 lwa13
2019-03-21 15:37:29 [INFO    ] DP 1: 13 lwa26
2019-03-21 15:37:29 [INFO    ] DP 1: 14 lwa14
2019-03-21 15:37:29 [INFO    ] DP 1: 16 lwa22
2019-03-21 15:37:29 [INFO    ] DP 1: 17 lwa20
2019-03-21 15:37:29 [INFO    ] DP 1: 18 lwa1
2019-03-21 15:37:29 [INFO    ] DP 1: 19 lwa5
2019-03-21 15:37:29 [INFO    ] DP 1: 20 lwa25
2019-03-21 15:37:29 [INFO    ] DP 1: 21 lwa35
2019-03-21 15:37:29 [INFO    ] DP 1: 22 lwa19
2019-03-21 15:37:29 [INFO    ] DP 1: 23 lwa21
2019-03-21 15:37:29 [INFO    ] DP 1: 24 lwa6
2019-03-21 15:37:29 [INFO    ] DP 1: 25 lwa7
2019-03-21 15:37:29 [INFO    ] DP 1: 26 lwa33
2019-03-21 15:37:29 [INFO    ] DP 1: 27 lwa15
2019-03-21 15:37:29 [INFO    ] DP 1: 28 lwa28
2019-03-21 15:37:29 [INFO    ] DP 2: 1 lwa16
2019-03-21 15:37:29 [INFO    ] DP 2: 15 lwa34
2019-03-21 15:37:29 [INFO    ] Total of 28 boards
2019-03-21 15:37:29 [INFO    ] Total of 260 stands
2019-03-21 15:37:29 [INFO    ] -------------------
2019-03-21 15:37:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4371
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4372
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4373
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4374
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4375
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4376
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4377
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4378
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4379
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4380
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4381
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4382
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4383
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4384
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4385
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4386
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4387
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4388
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4389
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4390
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4391
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4392
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4393
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4394
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4395
2019-03-21 15:37:36 [DEBUG   ] 2019-03-21 15:37:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4396
2019-03-21 15:37:40 [DEBUG   ] Got command RPT from MCS: ref #92218
2019-03-21 15:37:40 [DEBUG   ] summary = BOOTING
2019-03-21 15:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92218  15 58563 56260779 ABOOTINGBOOTING'
2019-03-21 15:37:40 [DEBUG   ] Got command RPT from MCS: ref #92219
2019-03-21 15:37:40 [DEBUG   ] info = Running INI sequence
2019-03-21 15:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92219  28 58563 56260779 ABOOTINGRunning INI sequence'
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4371 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4372 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4373 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4374 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4375 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4376 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4377 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4378 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4379 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4380 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4381 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4382 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4383 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4384 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4385 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4386 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4387 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4388 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4389 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4390 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4391 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4392 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4393 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4394 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4395 exited with status 0
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4396 exited with status 0
2019-03-21 15:37:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] spawn_process: at 2019-03-21 15:37:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4423
2019-03-21 15:37:49 [DEBUG   ] 2019-03-21 15:37:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4424
2019-03-21 15:37:54 [DEBUG   ] 2019-03-21 15:37:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4423 exited with status 0
2019-03-21 15:37:54 [DEBUG   ] 2019-03-21 15:37:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4424 exited with status 0
2019-03-21 15:37:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-03-21 15:37:54 [DEBUG   ] spawn_process: at 2019-03-21 15:37:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-03-21 15:37:54 [DEBUG   ] spawn_process: at 2019-03-21 15:37:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-03-21 15:37:54 [INFO    ] Setting Beam 1 xbars
2019-03-21 15:37:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-03-21 15:37:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-03-21 15:37:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-03-21 15:37:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-03-21 15:37:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-03-21 15:37:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-03-21 15:37:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-03-21 15:37:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-03-21 15:37:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-03-21 15:37:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-03-21 15:37:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-03-21 15:37:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-03-21 15:37:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-03-21 15:37:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-03-21 15:37:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-03-21 15:37:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-03-21 15:37:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-03-21 15:37:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-03-21 15:37:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-03-21 15:37:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-03-21 15:37:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-03-21 15:37:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-03-21 15:37:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-03-21 15:37:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-03-21 15:37:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-03-21 15:37:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-03-21 15:37:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-03-21 15:37:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-03-21 15:37:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-03-21 15:37:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-03-21 15:37:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-03-21 15:37:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-03-21 15:37:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-03-21 15:37:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-03-21 15:37:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-03-21 15:37:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-03-21 15:37:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-03-21 15:37:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-03-21 15:37:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-03-21 15:37:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-03-21 15:38:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-03-21 15:38:00 [INFO    ] Setting Beam 2 xbars
2019-03-21 15:38:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-03-21 15:38:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-03-21 15:38:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-03-21 15:38:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-03-21 15:38:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-03-21 15:38:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-03-21 15:38:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-03-21 15:38:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-03-21 15:38:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-03-21 15:38:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-03-21 15:38:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-03-21 15:38:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-03-21 15:38:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-03-21 15:38:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-03-21 15:38:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-03-21 15:38:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-03-21 15:38:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-03-21 15:38:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-03-21 15:38:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-03-21 15:38:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-03-21 15:38:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-03-21 15:38:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-03-21 15:38:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-03-21 15:38:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-03-21 15:38:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-03-21 15:38:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-03-21 15:38:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-03-21 15:38:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-03-21 15:38:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-03-21 15:38:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-03-21 15:38:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-03-21 15:38:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-03-21 15:38:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-03-21 15:38:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-03-21 15:38:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-03-21 15:38:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-03-21 15:38:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-03-21 15:38:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-03-21 15:38:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-03-21 15:38:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-03-21 15:38:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-03-21 15:38:05 [INFO    ] Setting Beam 3 xbars
2019-03-21 15:38:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-03-21 15:38:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-03-21 15:38:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-03-21 15:38:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-03-21 15:38:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-03-21 15:38:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-03-21 15:38:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-03-21 15:38:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-03-21 15:38:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-03-21 15:38:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-03-21 15:38:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-03-21 15:38:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-03-21 15:38:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-03-21 15:38:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-03-21 15:38:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-03-21 15:38:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-03-21 15:38:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-03-21 15:38:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-03-21 15:38:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-03-21 15:38:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-03-21 15:38:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-03-21 15:38:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-03-21 15:38:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-03-21 15:38:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-03-21 15:38:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-03-21 15:38:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-03-21 15:38:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-03-21 15:38:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-03-21 15:38:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-03-21 15:38:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-03-21 15:38:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-03-21 15:38:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-03-21 15:38:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-03-21 15:38:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-03-21 15:38:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-03-21 15:38:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-03-21 15:38:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-03-21 15:38:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-03-21 15:38:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-03-21 15:38:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-03-21 15:38:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-03-21 15:38:10 [INFO    ] Setting Beam 4 xbars
2019-03-21 15:38:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-03-21 15:38:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-03-21 15:38:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-03-21 15:38:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-03-21 15:38:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-03-21 15:38:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-03-21 15:38:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-03-21 15:38:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-03-21 15:38:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-03-21 15:38:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-03-21 15:38:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-03-21 15:38:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-03-21 15:38:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-03-21 15:38:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-03-21 15:38:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-03-21 15:38:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-03-21 15:38:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-03-21 15:38:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-03-21 15:38:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-03-21 15:38:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-03-21 15:38:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-03-21 15:38:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-03-21 15:38:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-03-21 15:38:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-03-21 15:38:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-03-21 15:38:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-03-21 15:38:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-03-21 15:38:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-03-21 15:38:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-03-21 15:38:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-03-21 15:38:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-03-21 15:38:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-03-21 15:38:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-03-21 15:38:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-03-21 15:38:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-03-21 15:38:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-03-21 15:38:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-03-21 15:38:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-03-21 15:38:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-03-21 15:38:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-03-21 15:38:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-03-21 15:38:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-03-21 15:38:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-03-21 15:38:16 [INFO    ] All xbars set
2019-03-21 15:38:16 [INFO    ] Setting adder chain routing for all beams
2019-03-21 15:38:21 [INFO    ] Setting beam ids
2019-03-21 15:38:31 [INFO    ] Starting beam delay calibration
2019-03-21 15:38:43 [INFO    ] Beam 1 latency is 5727
2019-03-21 15:38:43 [INFO    ] Beam 2 latency is 6695
2019-03-21 15:38:43 [INFO    ] Beam 3 latency is 6689
2019-03-21 15:38:43 [INFO    ] Beam 4 latency is 5704
2019-03-21 15:38:43 [INFO    ] Stop calibration
2019-03-21 15:38:51 [ERROR   ] Beam delay calibration failed
2019-03-21 15:38:51 [CRITICAL] Calibration failed
2019-03-21 15:38:51 [DEBUG   ] spawn_process: at 2019-03-21 15:38:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-03-21 15:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-03-21 15:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-03-21 15:38:51 [DEBUG   ] spawn_process: at 2019-03-21 15:38:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-03-21 15:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-03-21 15:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-03-21 15:38:51 [DEBUG   ] spawn_process: at 2019-03-21 15:38:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-03-21 15:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-03-21 15:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-03-21 15:38:51 [DEBUG   ] spawn_process: at 2019-03-21 15:38:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-03-21 15:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-03-21 15:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-03-21 15:38:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-03-21 15:38:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 267 ms (1553182732.268 s) with PID 5996 and time 1553182733
2019-03-21 15:38:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-03-21 15:38:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 357 ms (1553182732.358 s) with PID 5999 and time 1553182733
2019-03-21 15:38:53 [DEBUG   ] Finished updating ant stats in 0.889 seconds
2019-03-21 15:38:53 [INFO    ] Started antennas statistics background thread
2019-03-21 15:38:53 [INFO    ] Started board flags background thread
2019-03-21 15:38:53 [INFO    ] Started BAM background thread
2019-03-21 15:38:53 [INFO    ] Finished the INI process (ref. #92217) in 107.730 s
2019-03-21 15:38:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:38:54 [WARNING ] (13, 1, 'bot')
2019-03-21 15:38:54 [WARNING ] (13, 1, 'bot')
2019-03-21 15:38:54 [WARNING ] (13, 1, 'bot')
2019-03-21 15:38:54 [WARNING ] (13, 1, 'bot')
2019-03-21 15:38:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-03-21 15:38:54 [DEBUG   ] Finished updating board flags in 1.073 seconds
2019-03-21 15:39:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 15:39:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 15:39:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 15:39:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:39:54 [WARNING ] (13, 1, 'bot')
2019-03-21 15:39:54 [WARNING ] (13, 1, 'bot')
2019-03-21 15:39:54 [WARNING ] (13, 1, 'bot')
2019-03-21 15:39:54 [WARNING ] (13, 1, 'bot')
2019-03-21 15:39:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2019-03-21 15:39:54 [DEBUG   ] Finished updating board flags in 0.994 seconds
2019-03-21 15:40:05 [DEBUG   ] Got command RPT from MCS: ref #92241
2019-03-21 15:40:05 [DEBUG   ] summary = ERROR
2019-03-21 15:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92241  13 58563 56405751 A  ERRORERROR'
2019-03-21 15:40:05 [DEBUG   ] Got command RPT from MCS: ref #92242
2019-03-21 15:40:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92242  98 58563 56405751 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:40:10 [DEBUG   ] Got command INI from MCS: ref #92243
2019-03-21 15:40:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-03-21 15:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    92243   8 58563 56410759 ABOOTING'
2019-03-21 15:40:13 [DEBUG   ] Finished updating ant stats in 0.821 seconds
2019-03-21 15:40:31 [INFO    ] -------------------
2019-03-21 15:40:31 [INFO    ]  LWA board status
2019-03-21 15:40:31 [INFO    ] -------------------
2019-03-21 15:40:31 [INFO    ] DP 1: 2 lwa27
2019-03-21 15:40:31 [INFO    ] DP 1: 3 lwa24
2019-03-21 15:40:31 [INFO    ] DP 1: 4 lwa23
2019-03-21 15:40:31 [INFO    ] DP 1: 5 lwa18
2019-03-21 15:40:31 [INFO    ] DP 1: 6 lwa10
2019-03-21 15:40:31 [INFO    ] DP 1: 7 lwa32
2019-03-21 15:40:31 [INFO    ] DP 1: 8 lwa11
2019-03-21 15:40:31 [INFO    ] DP 1: 9 lwa30
2019-03-21 15:40:31 [INFO    ] DP 1: 10 lwa12
2019-03-21 15:40:31 [INFO    ] DP 1: 11 lwa8
2019-03-21 15:40:31 [INFO    ] DP 1: 12 lwa13
2019-03-21 15:40:31 [INFO    ] DP 1: 13 lwa26
2019-03-21 15:40:31 [INFO    ] DP 1: 14 lwa14
2019-03-21 15:40:31 [INFO    ] DP 1: 16 lwa22
2019-03-21 15:40:31 [INFO    ] DP 1: 17 lwa20
2019-03-21 15:40:31 [INFO    ] DP 1: 18 lwa1
2019-03-21 15:40:31 [INFO    ] DP 1: 19 lwa5
2019-03-21 15:40:31 [INFO    ] DP 1: 20 lwa25
2019-03-21 15:40:31 [INFO    ] DP 1: 21 lwa35
2019-03-21 15:40:31 [INFO    ] DP 1: 22 lwa19
2019-03-21 15:40:31 [INFO    ] DP 1: 23 lwa21
2019-03-21 15:40:31 [INFO    ] DP 1: 24 lwa6
2019-03-21 15:40:31 [INFO    ] DP 1: 25 lwa7
2019-03-21 15:40:31 [INFO    ] DP 1: 26 lwa33
2019-03-21 15:40:31 [INFO    ] DP 1: 27 lwa15
2019-03-21 15:40:31 [INFO    ] DP 1: 28 lwa28
2019-03-21 15:40:31 [INFO    ] DP 2: 1 lwa16
2019-03-21 15:40:31 [INFO    ] DP 2: 15 lwa34
2019-03-21 15:40:31 [INFO    ] Total of 28 boards
2019-03-21 15:40:31 [INFO    ] Total of 260 stands
2019-03-21 15:40:31 [INFO    ] -------------------
2019-03-21 15:40:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6585
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6586
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6587
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6588
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6589
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6590
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6591
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6592
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6593
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6594
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6595
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6596
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6597
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6598
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6599
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6600
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6601
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6602
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6603
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6604
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6605
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6606
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6607
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6608
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6609
2019-03-21 15:40:38 [DEBUG   ] 2019-03-21 15:40:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6610
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6585 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6586 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6587 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6588 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6589 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6590 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6591 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6592 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6593 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6594 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6595 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6596 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6597 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6598 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6599 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6600 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6601 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6602 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6603 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6604 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6605 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6606 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6607 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6608 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6609 exited with status 0
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6610 exited with status 0
2019-03-21 15:40:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] spawn_process: at 2019-03-21 15:40:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6637
2019-03-21 15:40:50 [DEBUG   ] 2019-03-21 15:40:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6638
2019-03-21 15:40:56 [DEBUG   ] 2019-03-21 15:40:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6637 exited with status 0
2019-03-21 15:40:56 [DEBUG   ] 2019-03-21 15:40:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6638 exited with status 0
2019-03-21 15:40:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-03-21 15:40:56 [DEBUG   ] spawn_process: at 2019-03-21 15:40:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-03-21 15:40:56 [DEBUG   ] spawn_process: at 2019-03-21 15:40:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-03-21 15:40:56 [INFO    ] Setting Beam 1 xbars
2019-03-21 15:40:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-03-21 15:40:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-03-21 15:40:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-03-21 15:40:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-03-21 15:40:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-03-21 15:40:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-03-21 15:40:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-03-21 15:40:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-03-21 15:40:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-03-21 15:40:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-03-21 15:40:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-03-21 15:40:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-03-21 15:40:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-03-21 15:40:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-03-21 15:40:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-03-21 15:40:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-03-21 15:40:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-03-21 15:40:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-03-21 15:40:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-03-21 15:40:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-03-21 15:40:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-03-21 15:40:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-03-21 15:40:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-03-21 15:40:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-03-21 15:40:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-03-21 15:40:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-03-21 15:40:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-03-21 15:40:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-03-21 15:40:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-03-21 15:40:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-03-21 15:40:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-03-21 15:40:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-03-21 15:41:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-03-21 15:41:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-03-21 15:41:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-03-21 15:41:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-03-21 15:41:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-03-21 15:41:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-03-21 15:41:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-03-21 15:41:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-03-21 15:41:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-03-21 15:41:01 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-03-21 15:41:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-03-21 15:41:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-03-21 15:41:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-03-21 15:41:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-03-21 15:41:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-03-21 15:41:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-03-21 15:41:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-03-21 15:41:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-03-21 15:41:01 [INFO    ] Setting Beam 2 xbars
2019-03-21 15:41:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-03-21 15:41:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-03-21 15:41:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-03-21 15:41:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-03-21 15:41:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-03-21 15:41:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-03-21 15:41:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-03-21 15:41:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-03-21 15:41:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-03-21 15:41:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-03-21 15:41:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-03-21 15:41:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-03-21 15:41:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-03-21 15:41:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-03-21 15:41:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-03-21 15:41:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-03-21 15:41:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-03-21 15:41:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-03-21 15:41:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-03-21 15:41:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-03-21 15:41:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-03-21 15:41:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-03-21 15:41:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-03-21 15:41:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-03-21 15:41:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-03-21 15:41:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-03-21 15:41:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-03-21 15:41:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-03-21 15:41:05 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-03-21 15:41:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-03-21 15:41:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-03-21 15:41:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-03-21 15:41:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-03-21 15:41:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-03-21 15:41:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-03-21 15:41:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-03-21 15:41:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-03-21 15:41:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-03-21 15:41:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-03-21 15:41:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-03-21 15:41:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-03-21 15:41:07 [INFO    ] Setting Beam 3 xbars
2019-03-21 15:41:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-03-21 15:41:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-03-21 15:41:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-03-21 15:41:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-03-21 15:41:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-03-21 15:41:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-03-21 15:41:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-03-21 15:41:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-03-21 15:41:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-03-21 15:41:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-03-21 15:41:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-03-21 15:41:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-03-21 15:41:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-03-21 15:41:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-03-21 15:41:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-03-21 15:41:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-03-21 15:41:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-03-21 15:41:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-03-21 15:41:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-03-21 15:41:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-03-21 15:41:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-03-21 15:41:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-03-21 15:41:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-03-21 15:41:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-03-21 15:41:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-03-21 15:41:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-03-21 15:41:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-03-21 15:41:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-03-21 15:41:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-03-21 15:41:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-03-21 15:41:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-03-21 15:41:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-03-21 15:41:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-03-21 15:41:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-03-21 15:41:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-03-21 15:41:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-03-21 15:41:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-03-21 15:41:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-03-21 15:41:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-03-21 15:41:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-03-21 15:41:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-03-21 15:41:12 [INFO    ] Setting Beam 4 xbars
2019-03-21 15:41:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-03-21 15:41:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-03-21 15:41:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-03-21 15:41:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-03-21 15:41:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-03-21 15:41:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-03-21 15:41:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-03-21 15:41:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-03-21 15:41:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-03-21 15:41:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-03-21 15:41:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-03-21 15:41:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-03-21 15:41:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-03-21 15:41:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-03-21 15:41:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-03-21 15:41:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-03-21 15:41:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-03-21 15:41:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-03-21 15:41:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-03-21 15:41:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-03-21 15:41:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-03-21 15:41:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-03-21 15:41:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-03-21 15:41:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-03-21 15:41:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-03-21 15:41:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-03-21 15:41:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-03-21 15:41:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-03-21 15:41:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-03-21 15:41:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-03-21 15:41:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-03-21 15:41:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-03-21 15:41:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-03-21 15:41:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-03-21 15:41:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-03-21 15:41:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-03-21 15:41:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-03-21 15:41:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-03-21 15:41:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-03-21 15:41:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-03-21 15:41:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-03-21 15:41:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-03-21 15:41:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-03-21 15:41:18 [INFO    ] All xbars set
2019-03-21 15:41:18 [INFO    ] Setting adder chain routing for all beams
2019-03-21 15:41:23 [INFO    ] Setting beam ids
2019-03-21 15:41:33 [INFO    ] Starting beam delay calibration
2019-03-21 15:41:40 [DEBUG   ] Got command RPT from MCS: ref #92244
2019-03-21 15:41:40 [DEBUG   ] summary = BOOTING
2019-03-21 15:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92244  15 58563 56500827 ABOOTINGBOOTING'
2019-03-21 15:41:45 [INFO    ] Beam 1 latency is 5698
2019-03-21 15:41:45 [INFO    ] Beam 2 latency is 5730
2019-03-21 15:41:45 [INFO    ] Beam 3 latency is 5729
2019-03-21 15:41:45 [INFO    ] Beam 4 latency is 5715
2019-03-21 15:41:45 [INFO    ] Stop calibration
2019-03-21 15:41:53 [INFO    ] Beam delay calibration successful
2019-03-21 15:41:53 [INFO    ] Calibration passed
2019-03-21 15:41:53 [DEBUG   ] spawn_process: at 2019-03-21 15:41:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-03-21 15:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-03-21 15:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-03-21 15:41:53 [DEBUG   ] spawn_process: at 2019-03-21 15:41:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-03-21 15:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-03-21 15:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-03-21 15:41:53 [DEBUG   ] spawn_process: at 2019-03-21 15:41:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-03-21 15:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-03-21 15:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-03-21 15:41:53 [DEBUG   ] spawn_process: at 2019-03-21 15:41:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-03-21 15:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-03-21 15:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-03-21 15:41:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-03-21 15:41:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 284 ms (1553182914.286 s) with PID 8320 and time 1553182915
2019-03-21 15:41:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2019-03-21 15:41:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 374 ms (1553182914.376 s) with PID 8323 and time 1553182915
2019-03-21 15:41:55 [DEBUG   ] Finished updating ant stats in 0.871 seconds
2019-03-21 15:41:55 [INFO    ] Started antennas statistics background thread
2019-03-21 15:41:55 [INFO    ] Started board flags background thread
2019-03-21 15:41:55 [INFO    ] Started BAM background thread
2019-03-21 15:41:55 [INFO    ] Finished the INI process (ref. #92243) in 104.742 s
2019-03-21 15:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:41:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:41:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:41:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:41:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:41:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:41:56 [DEBUG   ] Finished updating board flags in 1.058 seconds
2019-03-21 15:42:15 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 15:42:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:42:40 [DEBUG   ] Got command RPT from MCS: ref #92251
2019-03-21 15:42:40 [DEBUG   ] summary = ERROR
2019-03-21 15:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92251  13 58563 56560779 A  ERRORERROR'
2019-03-21 15:42:40 [DEBUG   ] Got command RPT from MCS: ref #92252
2019-03-21 15:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92252  77 58563 56560779 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:42:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:42:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:42:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:42:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:42:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:42:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:42:56 [DEBUG   ] Finished updating board flags in 0.993 seconds
2019-03-21 15:43:10 [DEBUG   ] Got command RPT from MCS: ref #92268
2019-03-21 15:43:10 [DEBUG   ] summary = ERROR
2019-03-21 15:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92268  13 58563 56590763 A  ERRORERROR'
2019-03-21 15:43:10 [DEBUG   ] Got command RPT from MCS: ref #92269
2019-03-21 15:43:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92269  77 58563 56590763 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:43:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:43:35 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 15:43:55 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 15:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:43:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:43:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:43:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:43:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:43:56 [DEBUG   ] Finished updating board flags in 1.267 seconds
2019-03-21 15:44:15 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-21 15:44:35 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 15:44:55 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 15:44:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:44:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:44:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:44:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:44:56 [WARNING ] (13, 1, 'bot')
2019-03-21 15:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:44:56 [DEBUG   ] Finished updating board flags in 1.224 seconds
2019-03-21 15:45:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:45:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:45:56 [DEBUG   ] Finished updating ant stats in 1.225 seconds
2019-03-21 15:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:45:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:45:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:45:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:45:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:45:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:45:57 [DEBUG   ] Finished updating board flags in 1.741 seconds
2019-03-21 15:46:16 [DEBUG   ] Finished updating ant stats in 1.172 seconds
2019-03-21 15:46:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 15:46:40 [DEBUG   ] Got command RPT from MCS: ref #92278
2019-03-21 15:46:40 [DEBUG   ] summary = ERROR
2019-03-21 15:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92278  13 58563 56800907 A  ERRORERROR'
2019-03-21 15:46:41 [DEBUG   ] Got command RPT from MCS: ref #92279
2019-03-21 15:46:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92279  77 58563 56801111 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:46:41 [DEBUG   ] Got command RPT from MCS: ref #92280
2019-03-21 15:46:41 [DEBUG   ] summary = ERROR
2019-03-21 15:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92280  13 58563 56801303 A  ERRORERROR'
2019-03-21 15:46:41 [DEBUG   ] Got command RPT from MCS: ref #92281
2019-03-21 15:46:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92281  77 58563 56801507 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:46:41 [DEBUG   ] Got command RPT from MCS: ref #92283
2019-03-21 15:46:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92283  12 58563 56801711 A  ERRORB–™š'
2019-03-21 15:46:56 [DEBUG   ] Finished updating ant stats in 0.825 seconds
2019-03-21 15:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:46:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:46:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:46:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:46:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:46:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:46:57 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-03-21 15:47:16 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2019-03-21 15:47:36 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-21 15:47:40 [DEBUG   ] Got command RPT from MCS: ref #92288
2019-03-21 15:47:40 [DEBUG   ] summary = ERROR
2019-03-21 15:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92288  13 58563 56860791 A  ERRORERROR'
2019-03-21 15:47:40 [DEBUG   ] Got command RPT from MCS: ref #92289
2019-03-21 15:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92289  77 58563 56860791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:47:56 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2019-03-21 15:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:47:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:47:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:47:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:47:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:47:57 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-03-21 15:48:16 [DEBUG   ] Finished updating ant stats in 0.372 seconds
2019-03-21 15:48:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 15:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:48:57 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2019-03-21 15:48:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:48:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:48:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:48:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:48:57 [DEBUG   ] Finished updating board flags in 1.287 seconds
2019-03-21 15:49:17 [DEBUG   ] Finished updating ant stats in 1.177 seconds
2019-03-21 15:49:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 15:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:49:57 [DEBUG   ] Finished updating ant stats in 0.827 seconds
2019-03-21 15:49:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:49:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:49:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:49:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:49:57 [DEBUG   ] Finished updating board flags in 1.175 seconds
2019-03-21 15:50:17 [DEBUG   ] Finished updating ant stats in 0.772 seconds
2019-03-21 15:50:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:50:57 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2019-03-21 15:50:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:50:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:50:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:50:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:50:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:50:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:50:58 [DEBUG   ] Finished updating board flags in 1.961 seconds
2019-03-21 15:51:17 [DEBUG   ] Finished updating ant stats in 0.572 seconds
2019-03-21 15:51:37 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-03-21 15:51:40 [DEBUG   ] Got command RPT from MCS: ref #92317
2019-03-21 15:51:40 [DEBUG   ] summary = ERROR
2019-03-21 15:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92317  13 58563 57100991 A  ERRORERROR'
2019-03-21 15:51:41 [DEBUG   ] Got command RPT from MCS: ref #92318
2019-03-21 15:51:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92318  77 58563 57101195 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:51:41 [DEBUG   ] Got command RPT from MCS: ref #92319
2019-03-21 15:51:41 [DEBUG   ] summary = ERROR
2019-03-21 15:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92319  13 58563 57101387 A  ERRORERROR'
2019-03-21 15:51:41 [DEBUG   ] Got command RPT from MCS: ref #92320
2019-03-21 15:51:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92320  77 58563 57101591 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:51:41 [DEBUG   ] Got command RPT from MCS: ref #92321
2019-03-21 15:51:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92321  12 58563 57101795 A  ERRORB–™š'
2019-03-21 15:51:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 15:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:51:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:51:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:51:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:51:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:51:59 [DEBUG   ] Finished updating board flags in 2.800 seconds
2019-03-21 15:52:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:52:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:52:40 [DEBUG   ] Got command RPT from MCS: ref #92322
2019-03-21 15:52:40 [DEBUG   ] summary = ERROR
2019-03-21 15:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92322  13 58563 57160791 A  ERRORERROR'
2019-03-21 15:52:40 [DEBUG   ] Got command RPT from MCS: ref #92323
2019-03-21 15:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92323  77 58563 57160791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:52:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:52:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 15:52:58 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2019-03-21 15:52:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:52:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:52:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:52:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:52:58 [DEBUG   ] Finished updating board flags in 1.667 seconds
2019-03-21 15:53:18 [DEBUG   ] Finished updating ant stats in 1.173 seconds
2019-03-21 15:53:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 15:53:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:53:58 [DEBUG   ] Finished updating ant stats in 1.025 seconds
2019-03-21 15:53:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:53:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:53:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:53:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:53:58 [DEBUG   ] Finished updating board flags in 1.634 seconds
2019-03-21 15:54:18 [DEBUG   ] Finished updating ant stats in 0.972 seconds
2019-03-21 15:54:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 15:54:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 15:54:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:54:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:54:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:54:57 [WARNING ] (13, 1, 'bot')
2019-03-21 15:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:54:57 [DEBUG   ] Finished updating board flags in 0.982 seconds
2019-03-21 15:54:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 15:55:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:55:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 15:55:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:55:58 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2019-03-21 15:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 15:55:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:55:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:55:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:55:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:55:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:55:58 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-03-21 15:56:18 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2019-03-21 15:56:38 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 15:56:41 [DEBUG   ] Got command RPT from MCS: ref #92347
2019-03-21 15:56:41 [DEBUG   ] summary = ERROR
2019-03-21 15:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92347  13 58563 57401083 A  ERRORERROR'
2019-03-21 15:56:41 [DEBUG   ] Got command RPT from MCS: ref #92348
2019-03-21 15:56:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92348  77 58563 57401275 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:56:41 [DEBUG   ] Got command RPT from MCS: ref #92349
2019-03-21 15:56:41 [DEBUG   ] summary = ERROR
2019-03-21 15:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92349  13 58563 57401479 A  ERRORERROR'
2019-03-21 15:56:41 [DEBUG   ] Got command RPT from MCS: ref #92351
2019-03-21 15:56:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92351  77 58563 57401683 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:56:41 [DEBUG   ] Got command RPT from MCS: ref #92352
2019-03-21 15:56:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 15:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92352  12 58563 57401887 A  ERRORB–™š'
2019-03-21 15:56:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:56:58 [DEBUG   ] Finished updating ant stats in 0.428 seconds
2019-03-21 15:56:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:56:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:56:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:56:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:56:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:56:58 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-03-21 15:57:09 [DEBUG   ] Got command BAM from MCS: ref #92367
2019-03-21 15:57:09 [INFO    ] Finished processing BAM request
2019-03-21 15:57:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92367   8 58563 57429035 A  ERROR'
2019-03-21 15:57:09 [DEBUG   ] Got command BAM from MCS: ref #92368
2019-03-21 15:57:09 [INFO    ] Finished processing BAM request
2019-03-21 15:57:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92368   8 58563 57429039 A  ERROR'
2019-03-21 15:57:09 [DEBUG   ] Got command DRX from MCS: ref #92369
2019-03-21 15:57:09 [INFO    ] sending drx command to lwa16
2019-03-21 15:57:09 [DEBUG   ] run_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35000000.0 6 9 27']
2019-03-21 15:57:09 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 15:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    92369   8 58563 57429283 A  ERROR'
2019-03-21 15:57:09 [DEBUG   ] Got command DRX from MCS: ref #92370
2019-03-21 15:57:09 [INFO    ] sending drx command to lwa34
2019-03-21 15:57:09 [DEBUG   ] run_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35000000.0 6 9 27']
2019-03-21 15:57:09 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 15:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    92370   8 58563 57429287 A  ERROR'
2019-03-21 15:57:09 [DEBUG   ] Got command DRX from MCS: ref #92372
2019-03-21 15:57:09 [INFO    ] sending drx command to lwa34
2019-03-21 15:57:09 [DEBUG   ] run_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 45000000.0 6 9 27']
2019-03-21 15:57:09 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 15:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    92372   8 58563 57429291 A  ERROR'
2019-03-21 15:57:09 [DEBUG   ] Got command DRX from MCS: ref #92371
2019-03-21 15:57:09 [INFO    ] sending drx command to lwa16
2019-03-21 15:57:09 [DEBUG   ] run_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 45000000.0 6 9 27']
2019-03-21 15:57:09 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 15:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    92371   8 58563 57429295 A  ERROR'
2019-03-21 15:57:09 [INFO    ] Finished starting DRX
2019-03-21 15:57:09 [INFO    ] Finished starting DRX
2019-03-21 15:57:09 [INFO    ] Finished starting DRX
2019-03-21 15:57:09 [INFO    ] Finished starting DRX
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 15:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 15:57:09 [DEBUG   ] spawn_process: at 2019-03-21 15:57:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 15:57:18 [DEBUG   ] Finished updating ant stats in 0.376 seconds
2019-03-21 15:57:30 [DEBUG   ] Got command BAM from MCS: ref #92375
2019-03-21 15:57:30 [INFO    ] Finished processing BAM request
2019-03-21 15:57:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92375   8 58563 57450031 A  ERROR'
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 15:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 15:57:30 [DEBUG   ] spawn_process: at 2019-03-21 15:57:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 15:57:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 15:57:40 [DEBUG   ] Got command RPT from MCS: ref #92376
2019-03-21 15:57:40 [DEBUG   ] summary = ERROR
2019-03-21 15:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92376  13 58563 57460783 A  ERRORERROR'
2019-03-21 15:57:40 [DEBUG   ] Got command RPT from MCS: ref #92377
2019-03-21 15:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 15:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92377  77 58563 57460783 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 15:57:51 [DEBUG   ] Got command BAM from MCS: ref #92393
2019-03-21 15:57:51 [INFO    ] Finished processing BAM request
2019-03-21 15:57:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:57:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92393   8 58563 57471023 A  ERROR'
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 15:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 15:57:51 [DEBUG   ] spawn_process: at 2019-03-21 15:57:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 15:57:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:57:59 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2019-03-21 15:57:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:57:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:57:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:57:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:57:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:57:59 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-03-21 15:58:12 [DEBUG   ] Got command BAM from MCS: ref #92394
2019-03-21 15:58:12 [INFO    ] Finished processing BAM request
2019-03-21 15:58:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92394   8 58563 57492035 A  ERROR'
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 15:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 15:58:12 [DEBUG   ] spawn_process: at 2019-03-21 15:58:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 15:58:19 [DEBUG   ] Finished updating ant stats in 1.172 seconds
2019-03-21 15:58:34 [DEBUG   ] Got command BAM from MCS: ref #92395
2019-03-21 15:58:34 [INFO    ] Finished processing BAM request
2019-03-21 15:58:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92395   8 58563 57514023 A  ERROR'
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 15:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 15:58:34 [DEBUG   ] spawn_process: at 2019-03-21 15:58:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 15:58:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 15:58:52 [DEBUG   ] Got command BAM from MCS: ref #92396
2019-03-21 15:58:52 [INFO    ] Finished processing BAM request
2019-03-21 15:58:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92396   8 58563 57532035 A  ERROR'
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 15:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 15:58:52 [DEBUG   ] spawn_process: at 2019-03-21 15:58:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 15:58:56 [DEBUG   ] Got command BAM from MCS: ref #92397
2019-03-21 15:58:56 [INFO    ] Finished processing BAM request
2019-03-21 15:58:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:58:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92397   8 58563 57536035 A  ERROR'
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 15:58:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 15:58:56 [DEBUG   ] spawn_process: at 2019-03-21 15:58:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 15:58:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 15:58:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 15:58:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:58:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:58:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:58:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:58:58 [WARNING ] (13, 1, 'bot')
2019-03-21 15:58:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:58:58 [DEBUG   ] Finished updating board flags in 1.226 seconds
2019-03-21 15:58:59 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-21 15:59:18 [DEBUG   ] Got command BAM from MCS: ref #92398
2019-03-21 15:59:18 [INFO    ] Finished processing BAM request
2019-03-21 15:59:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92398   8 58563 57558031 A  ERROR'
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 15:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 15:59:18 [DEBUG   ] spawn_process: at 2019-03-21 15:59:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 15:59:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 15:59:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 15:59:40 [DEBUG   ] Got command BAM from MCS: ref #92399
2019-03-21 15:59:40 [INFO    ] Finished processing BAM request
2019-03-21 15:59:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 15:59:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92399   8 58563 57580027 A  ERROR'
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 15:59:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 15:59:40 [DEBUG   ] spawn_process: at 2019-03-21 15:59:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 15:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2019-03-21 15:59:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 15:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-03-21 15:59:59 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-03-21 15:59:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:59:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:59:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:59:59 [WARNING ] (13, 1, 'bot')
2019-03-21 15:59:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 15:59:59 [DEBUG   ] Finished updating board flags in 1.910 seconds
2019-03-21 16:00:03 [DEBUG   ] Got command BAM from MCS: ref #92406
2019-03-21 16:00:03 [INFO    ] Finished processing BAM request
2019-03-21 16:00:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92406   8 58563 57603031 A  ERROR'
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:00:03 [DEBUG   ] spawn_process: at 2019-03-21 16:00:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:00:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:00:26 [DEBUG   ] Got command BAM from MCS: ref #92407
2019-03-21 16:00:26 [INFO    ] Finished processing BAM request
2019-03-21 16:00:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92407   8 58563 57626031 A  ERROR'
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:00:26 [DEBUG   ] spawn_process: at 2019-03-21 16:00:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:00:35 [DEBUG   ] Got command BAM from MCS: ref #92408
2019-03-21 16:00:35 [INFO    ] Finished processing BAM request
2019-03-21 16:00:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92408   8 58563 57635035 A  ERROR'
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:00:35 [DEBUG   ] spawn_process: at 2019-03-21 16:00:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:00:39 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 16:00:49 [DEBUG   ] Got command BAM from MCS: ref #92409
2019-03-21 16:00:49 [INFO    ] Finished processing BAM request
2019-03-21 16:00:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92409   8 58563 57649031 A  ERROR'
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:00:49 [DEBUG   ] spawn_process: at 2019-03-21 16:00:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:00:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:00:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:00:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:00:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:00:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:00:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:00:58 [DEBUG   ] Finished updating board flags in 1.062 seconds
2019-03-21 16:00:59 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:01:12 [DEBUG   ] Got command BAM from MCS: ref #92410
2019-03-21 16:01:12 [INFO    ] Finished processing BAM request
2019-03-21 16:01:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92410   8 58563 57672035 A  ERROR'
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:01:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:01:12 [DEBUG   ] spawn_process: at 2019-03-21 16:01:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:01:19 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 16:01:36 [DEBUG   ] Got command BAM from MCS: ref #92411
2019-03-21 16:01:36 [INFO    ] Finished processing BAM request
2019-03-21 16:01:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92411   8 58563 57696027 A  ERROR'
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:01:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:01:36 [DEBUG   ] spawn_process: at 2019-03-21 16:01:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:01:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:01:41 [DEBUG   ] Got command RPT from MCS: ref #92412
2019-03-21 16:01:41 [DEBUG   ] summary = ERROR
2019-03-21 16:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92412  13 58563 57701163 A  ERRORERROR'
2019-03-21 16:01:41 [DEBUG   ] Got command RPT from MCS: ref #92413
2019-03-21 16:01:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92413  77 58563 57701367 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:01:41 [DEBUG   ] Got command RPT from MCS: ref #92414
2019-03-21 16:01:41 [DEBUG   ] summary = ERROR
2019-03-21 16:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92414  13 58563 57701559 A  ERRORERROR'
2019-03-21 16:01:41 [DEBUG   ] Got command RPT from MCS: ref #92415
2019-03-21 16:01:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92415  77 58563 57701763 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:01:41 [DEBUG   ] Got command RPT from MCS: ref #92416
2019-03-21 16:01:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92416  12 58563 57701967 A  ERRORBŸff'
2019-03-21 16:01:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:01:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:01:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:01:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:01:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:01:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:01:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:01:58 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-03-21 16:02:00 [DEBUG   ] Got command BAM from MCS: ref #92417
2019-03-21 16:02:00 [INFO    ] Finished processing BAM request
2019-03-21 16:02:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92417   8 58563 57720027 A  ERROR'
2019-03-21 16:02:00 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:02:00 [DEBUG   ] spawn_process: at 2019-03-21 16:02:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:02:19 [DEBUG   ] Got command BAM from MCS: ref #92418
2019-03-21 16:02:19 [INFO    ] Finished processing BAM request
2019-03-21 16:02:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92418   8 58563 57739027 A  ERROR'
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:02:19 [DEBUG   ] spawn_process: at 2019-03-21 16:02:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:02:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:02:24 [DEBUG   ] Got command BAM from MCS: ref #92419
2019-03-21 16:02:24 [INFO    ] Finished processing BAM request
2019-03-21 16:02:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92419   8 58563 57744023 A  ERROR'
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:02:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:02:24 [DEBUG   ] spawn_process: at 2019-03-21 16:02:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:02:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:02:40 [DEBUG   ] Got command RPT from MCS: ref #92420
2019-03-21 16:02:40 [DEBUG   ] summary = ERROR
2019-03-21 16:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92420  13 58563 57760787 A  ERRORERROR'
2019-03-21 16:02:40 [DEBUG   ] Got command RPT from MCS: ref #92421
2019-03-21 16:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92421  77 58563 57760787 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:02:49 [DEBUG   ] Got command BAM from MCS: ref #92443
2019-03-21 16:02:49 [INFO    ] Finished processing BAM request
2019-03-21 16:02:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:02:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92443   8 58563 57769035 A  ERROR'
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:02:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:02:49 [DEBUG   ] spawn_process: at 2019-03-21 16:02:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-03-21 16:02:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:02:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:02:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:02:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:02:58 [WARNING ] (13, 1, 'bot')
2019-03-21 16:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:02:58 [DEBUG   ] Finished updating board flags in 0.968 seconds
2019-03-21 16:03:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:03:14 [DEBUG   ] Got command BAM from MCS: ref #92444
2019-03-21 16:03:14 [INFO    ] Finished processing BAM request
2019-03-21 16:03:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92444   8 58563 57794031 A  ERROR'
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:03:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:03:14 [DEBUG   ] spawn_process: at 2019-03-21 16:03:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:03:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:03:39 [DEBUG   ] Got command BAM from MCS: ref #92445
2019-03-21 16:03:39 [INFO    ] Finished processing BAM request
2019-03-21 16:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92445   8 58563 57819035 A  ERROR'
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:03:39 [DEBUG   ] spawn_process: at 2019-03-21 16:03:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:03:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:03:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:03:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:03:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:03:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:03:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:03:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:03:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:03:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:03:59 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-03-21 16:04:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:04:03 [DEBUG   ] Got command BAM from MCS: ref #92446
2019-03-21 16:04:03 [INFO    ] Finished processing BAM request
2019-03-21 16:04:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:04:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92446   8 58563 57843031 A  ERROR'
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:04:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:04:03 [DEBUG   ] spawn_process: at 2019-03-21 16:04:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:04:05 [DEBUG   ] Got command BAM from MCS: ref #92447
2019-03-21 16:04:05 [INFO    ] Finished processing BAM request
2019-03-21 16:04:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92447   8 58563 57845027 A  ERROR'
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:04:05 [DEBUG   ] spawn_process: at 2019-03-21 16:04:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:04:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:04:31 [DEBUG   ] Got command BAM from MCS: ref #92448
2019-03-21 16:04:31 [INFO    ] Finished processing BAM request
2019-03-21 16:04:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:04:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92448   8 58563 57871027 A  ERROR'
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:04:31 [DEBUG   ] spawn_process: at 2019-03-21 16:04:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:04:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 16:04:57 [DEBUG   ] Got command BAM from MCS: ref #92449
2019-03-21 16:04:57 [INFO    ] Finished processing BAM request
2019-03-21 16:04:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92449   8 58563 57897031 A  ERROR'
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:04:57 [DEBUG   ] spawn_process: at 2019-03-21 16:04:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 16:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:04:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:04:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:04:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:04:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:04:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:04:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:04:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:04:59 [DEBUG   ] Finished updating board flags in 1.182 seconds
2019-03-21 16:05:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:05:20 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 16:05:24 [DEBUG   ] Got command BAM from MCS: ref #92450
2019-03-21 16:05:24 [INFO    ] Finished processing BAM request
2019-03-21 16:05:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92450   8 58563 57924035 A  ERROR'
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:05:24 [DEBUG   ] spawn_process: at 2019-03-21 16:05:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:05:41 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-21 16:05:48 [DEBUG   ] Got command BAM from MCS: ref #92457
2019-03-21 16:05:48 [INFO    ] Finished processing BAM request
2019-03-21 16:05:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92457   8 58563 57948027 A  ERROR'
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:05:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:05:48 [DEBUG   ] spawn_process: at 2019-03-21 16:05:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:05:51 [DEBUG   ] Got command BAM from MCS: ref #92458
2019-03-21 16:05:51 [INFO    ] Finished processing BAM request
2019-03-21 16:05:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:05:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92458   8 58563 57951031 A  ERROR'
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:05:51 [DEBUG   ] spawn_process: at 2019-03-21 16:05:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:05:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:05:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 16:05:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:05:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:05:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:05:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:05:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:05:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:05:59 [DEBUG   ] Finished updating board flags in 0.999 seconds
2019-03-21 16:06:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:06:18 [DEBUG   ] Got command BAM from MCS: ref #92459
2019-03-21 16:06:18 [INFO    ] Finished processing BAM request
2019-03-21 16:06:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92459   8 58563 57978035 A  ERROR'
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:06:18 [DEBUG   ] spawn_process: at 2019-03-21 16:06:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:06:21 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 16:06:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:06:41 [DEBUG   ] Got command RPT from MCS: ref #92462
2019-03-21 16:06:41 [DEBUG   ] summary = ERROR
2019-03-21 16:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92462  13 58563 58001251 A  ERRORERROR'
2019-03-21 16:06:41 [DEBUG   ] Got command RPT from MCS: ref #92463
2019-03-21 16:06:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92463  77 58563 58001455 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:06:41 [DEBUG   ] Got command RPT from MCS: ref #92464
2019-03-21 16:06:41 [DEBUG   ] summary = ERROR
2019-03-21 16:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92464  13 58563 58001647 A  ERRORERROR'
2019-03-21 16:06:41 [DEBUG   ] Got command RPT from MCS: ref #92466
2019-03-21 16:06:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92466  77 58563 58001851 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:06:42 [DEBUG   ] Got command RPT from MCS: ref #92468
2019-03-21 16:06:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92468  12 58563 58002055 A  ERRORB ff'
2019-03-21 16:06:46 [DEBUG   ] Got command BAM from MCS: ref #92472
2019-03-21 16:06:46 [INFO    ] Finished processing BAM request
2019-03-21 16:06:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92472   8 58563 58006031 A  ERROR'
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:06:46 [DEBUG   ] spawn_process: at 2019-03-21 16:06:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:06:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:06:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 16:06:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:06:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:06:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:06:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:06:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:06:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:06:59 [DEBUG   ] Finished updating board flags in 1.267 seconds
2019-03-21 16:07:01 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 16:07:14 [DEBUG   ] Got command BAM from MCS: ref #92473
2019-03-21 16:07:14 [INFO    ] Finished processing BAM request
2019-03-21 16:07:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92473   8 58563 58034027 A  ERROR'
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:07:14 [DEBUG   ] spawn_process: at 2019-03-21 16:07:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:07:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 16:07:33 [DEBUG   ] Got command BAM from MCS: ref #92474
2019-03-21 16:07:33 [INFO    ] Finished processing BAM request
2019-03-21 16:07:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92474   8 58563 58053027 A  ERROR'
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:07:33 [DEBUG   ] spawn_process: at 2019-03-21 16:07:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:07:40 [DEBUG   ] Got command RPT from MCS: ref #92475
2019-03-21 16:07:40 [DEBUG   ] summary = ERROR
2019-03-21 16:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92475  13 58563 58060791 A  ERRORERROR'
2019-03-21 16:07:40 [DEBUG   ] Got command RPT from MCS: ref #92476
2019-03-21 16:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92476  77 58563 58060791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:07:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:07:43 [DEBUG   ] Got command BAM from MCS: ref #92492
2019-03-21 16:07:43 [INFO    ] Finished processing BAM request
2019-03-21 16:07:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92492   8 58563 58063027 A  ERROR'
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:07:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:07:43 [DEBUG   ] spawn_process: at 2019-03-21 16:07:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 16:07:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:07:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:07:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:07:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:07:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:07:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:07:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:07:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:07:59 [DEBUG   ] Finished updating board flags in 1.215 seconds
2019-03-21 16:08:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:08:12 [DEBUG   ] Got command BAM from MCS: ref #92493
2019-03-21 16:08:12 [INFO    ] Finished processing BAM request
2019-03-21 16:08:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:08:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92493   8 58563 58092035 A  ERROR'
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:08:12 [DEBUG   ] spawn_process: at 2019-03-21 16:08:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:08:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:08:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 16:08:42 [DEBUG   ] Got command BAM from MCS: ref #92494
2019-03-21 16:08:42 [INFO    ] Finished processing BAM request
2019-03-21 16:08:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:08:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92494   8 58563 58122027 A  ERROR'
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:08:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:08:42 [DEBUG   ] spawn_process: at 2019-03-21 16:08:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:08:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:08:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:08:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:08:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:08:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:08:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:08:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:08:59 [DEBUG   ] Finished updating board flags in 1.157 seconds
2019-03-21 16:09:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:09:12 [DEBUG   ] Got command BAM from MCS: ref #92501
2019-03-21 16:09:12 [INFO    ] Finished processing BAM request
2019-03-21 16:09:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92501   8 58563 58152031 A  ERROR'
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:09:12 [DEBUG   ] spawn_process: at 2019-03-21 16:09:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:09:19 [DEBUG   ] Got command BAM from MCS: ref #92502
2019-03-21 16:09:19 [INFO    ] Finished processing BAM request
2019-03-21 16:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92502   8 58563 58159031 A  ERROR'
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:09:19 [DEBUG   ] spawn_process: at 2019-03-21 16:09:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:09:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-21 16:09:41 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:09:43 [DEBUG   ] Got command BAM from MCS: ref #92503
2019-03-21 16:09:43 [INFO    ] Finished processing BAM request
2019-03-21 16:09:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:09:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92503   8 58563 58183035 A  ERROR'
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:09:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:09:43 [DEBUG   ] spawn_process: at 2019-03-21 16:09:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 16:09:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:09:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:09:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 16:09:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:09:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:09:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:09:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:09:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:09:59 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-03-21 16:10:01 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:10:14 [DEBUG   ] Got command BAM from MCS: ref #92504
2019-03-21 16:10:14 [INFO    ] Finished processing BAM request
2019-03-21 16:10:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92504   8 58563 58214023 A  ERROR'
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:10:14 [DEBUG   ] spawn_process: at 2019-03-21 16:10:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:10:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 16:10:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:10:46 [DEBUG   ] Got command BAM from MCS: ref #92505
2019-03-21 16:10:46 [INFO    ] Finished processing BAM request
2019-03-21 16:10:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:10:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92505   8 58563 58246023 A  ERROR'
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:10:46 [DEBUG   ] spawn_process: at 2019-03-21 16:10:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:10:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:10:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-03-21 16:10:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:10:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:10:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:10:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:10:59 [WARNING ] (13, 1, 'bot')
2019-03-21 16:10:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:10:59 [DEBUG   ] Finished updating board flags in 0.992 seconds
2019-03-21 16:11:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:11:05 [DEBUG   ] Got command BAM from MCS: ref #92506
2019-03-21 16:11:05 [INFO    ] Finished processing BAM request
2019-03-21 16:11:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92506   8 58563 58265023 A  ERROR'
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:11:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:11:05 [DEBUG   ] spawn_process: at 2019-03-21 16:11:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:11:18 [DEBUG   ] Got command BAM from MCS: ref #92507
2019-03-21 16:11:18 [INFO    ] Finished processing BAM request
2019-03-21 16:11:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:11:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92507   8 58563 58278023 A  ERROR'
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:11:18 [DEBUG   ] spawn_process: at 2019-03-21 16:11:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:11:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:11:41 [DEBUG   ] Got command RPT from MCS: ref #92508
2019-03-21 16:11:41 [DEBUG   ] summary = ERROR
2019-03-21 16:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92508  13 58563 58301339 A  ERRORERROR'
2019-03-21 16:11:41 [DEBUG   ] Got command RPT from MCS: ref #92509
2019-03-21 16:11:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92509  77 58563 58301531 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:11:41 [DEBUG   ] Got command RPT from MCS: ref #92510
2019-03-21 16:11:41 [DEBUG   ] summary = ERROR
2019-03-21 16:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92510  13 58563 58301735 A  ERRORERROR'
2019-03-21 16:11:41 [DEBUG   ] Got command RPT from MCS: ref #92511
2019-03-21 16:11:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92511  77 58563 58301939 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:11:42 [DEBUG   ] Got command RPT from MCS: ref #92512
2019-03-21 16:11:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92512  12 58563 58302143 A  ERRORB¡ff'
2019-03-21 16:11:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:11:51 [DEBUG   ] Got command BAM from MCS: ref #92519
2019-03-21 16:11:51 [INFO    ] Finished processing BAM request
2019-03-21 16:11:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92519   8 58563 58311027 A  ERROR'
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:11:51 [DEBUG   ] spawn_process: at 2019-03-21 16:11:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:11:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:11:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-03-21 16:12:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:12:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:12:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:12:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:12:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:12:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:12:00 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-03-21 16:12:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:12:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:12:24 [DEBUG   ] Got command BAM from MCS: ref #92520
2019-03-21 16:12:24 [INFO    ] Finished processing BAM request
2019-03-21 16:12:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92520   8 58563 58344031 A  ERROR'
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:12:24 [DEBUG   ] spawn_process: at 2019-03-21 16:12:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:12:40 [DEBUG   ] Got command RPT from MCS: ref #92521
2019-03-21 16:12:40 [DEBUG   ] summary = ERROR
2019-03-21 16:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92521  13 58563 58360795 A  ERRORERROR'
2019-03-21 16:12:40 [DEBUG   ] Got command RPT from MCS: ref #92522
2019-03-21 16:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92522  77 58563 58360795 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:12:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:12:52 [DEBUG   ] Got command BAM from MCS: ref #92538
2019-03-21 16:12:52 [INFO    ] Finished processing BAM request
2019-03-21 16:12:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:12:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92538   8 58563 58372031 A  ERROR'
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:12:52 [DEBUG   ] spawn_process: at 2019-03-21 16:12:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:12:58 [DEBUG   ] Got command BAM from MCS: ref #92539
2019-03-21 16:12:58 [INFO    ] Finished processing BAM request
2019-03-21 16:12:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:12:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92539   8 58563 58378023 A  ERROR'
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:12:58 [DEBUG   ] spawn_process: at 2019-03-21 16:12:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:12:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2019-03-21 16:12:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-03-21 16:12:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:13:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:13:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:13:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:13:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:13:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:13:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:13:00 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-03-21 16:13:02 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:13:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 16:13:32 [DEBUG   ] Got command BAM from MCS: ref #92540
2019-03-21 16:13:32 [INFO    ] Finished processing BAM request
2019-03-21 16:13:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92540   8 58563 58412027 A  ERROR'
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:13:32 [DEBUG   ] spawn_process: at 2019-03-21 16:13:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:13:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:13:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:14:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:14:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:14:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:14:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:14:00 [WARNING ] (13, 1, 'bot')
2019-03-21 16:14:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:14:00 [DEBUG   ] Finished updating board flags in 1.075 seconds
2019-03-21 16:14:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:14:07 [DEBUG   ] Got command BAM from MCS: ref #92541
2019-03-21 16:14:07 [INFO    ] Finished processing BAM request
2019-03-21 16:14:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:14:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92541   8 58563 58447027 A  ERROR'
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:14:07 [DEBUG   ] spawn_process: at 2019-03-21 16:14:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:14:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:14:38 [DEBUG   ] Got command BAM from MCS: ref #92542
2019-03-21 16:14:38 [INFO    ] Finished processing BAM request
2019-03-21 16:14:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92542   8 58563 58478027 A  ERROR'
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:14:38 [DEBUG   ] spawn_process: at 2019-03-21 16:14:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:14:43 [DEBUG   ] Got command BAM from MCS: ref #92543
2019-03-21 16:14:43 [INFO    ] Finished processing BAM request
2019-03-21 16:14:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:14:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92543   8 58563 58483031 A  ERROR'
2019-03-21 16:14:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:14:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:14:43 [DEBUG   ] spawn_process: at 2019-03-21 16:14:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:15:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-03-21 16:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:15:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:15:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:15:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:15:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:15:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:15:01 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-03-21 16:15:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 16:15:19 [DEBUG   ] Got command BAM from MCS: ref #92550
2019-03-21 16:15:19 [INFO    ] Finished processing BAM request
2019-03-21 16:15:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92550   8 58563 58519023 A  ERROR'
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:15:19 [DEBUG   ] spawn_process: at 2019-03-21 16:15:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:15:23 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:15:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:15:56 [DEBUG   ] Got command BAM from MCS: ref #92551
2019-03-21 16:15:56 [INFO    ] Finished processing BAM request
2019-03-21 16:15:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:15:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92551   8 58563 58556031 A  ERROR'
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:15:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:15:56 [DEBUG   ] spawn_process: at 2019-03-21 16:15:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:16:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:16:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:16:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:16:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:16:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:16:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:16:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:16:01 [DEBUG   ] Finished updating board flags in 1.327 seconds
2019-03-21 16:16:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:16:22 [DEBUG   ] Got command BAM from MCS: ref #92552
2019-03-21 16:16:22 [INFO    ] Finished processing BAM request
2019-03-21 16:16:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92552   8 58563 58582023 A  ERROR'
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:16:22 [DEBUG   ] spawn_process: at 2019-03-21 16:16:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:16:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 16:16:34 [DEBUG   ] Got command BAM from MCS: ref #92553
2019-03-21 16:16:34 [INFO    ] Finished processing BAM request
2019-03-21 16:16:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92553   8 58563 58594031 A  ERROR'
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:16:34 [DEBUG   ] spawn_process: at 2019-03-21 16:16:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:16:41 [DEBUG   ] Got command RPT from MCS: ref #92556
2019-03-21 16:16:41 [DEBUG   ] summary = ERROR
2019-03-21 16:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92556  13 58563 58601423 A  ERRORERROR'
2019-03-21 16:16:41 [DEBUG   ] Got command RPT from MCS: ref #92557
2019-03-21 16:16:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92557  77 58563 58601627 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:16:41 [DEBUG   ] Got command RPT from MCS: ref #92558
2019-03-21 16:16:41 [DEBUG   ] summary = ERROR
2019-03-21 16:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92558  13 58563 58601819 A  ERRORERROR'
2019-03-21 16:16:42 [DEBUG   ] Got command RPT from MCS: ref #92560
2019-03-21 16:16:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92560  77 58563 58602023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:16:42 [DEBUG   ] Got command RPT from MCS: ref #92561
2019-03-21 16:16:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92561  12 58563 58602227 A  ERRORB ff'
2019-03-21 16:16:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:17:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:17:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:17:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:17:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:17:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:17:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:17:01 [DEBUG   ] Finished updating board flags in 1.312 seconds
2019-03-21 16:17:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 16:17:12 [DEBUG   ] Got command BAM from MCS: ref #92566
2019-03-21 16:17:12 [INFO    ] Finished processing BAM request
2019-03-21 16:17:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:17:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92566   8 58563 58632031 A  ERROR'
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:17:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:17:12 [DEBUG   ] spawn_process: at 2019-03-21 16:17:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:17:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:17:40 [DEBUG   ] Got command RPT from MCS: ref #92567
2019-03-21 16:17:40 [DEBUG   ] summary = ERROR
2019-03-21 16:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92567  13 58563 58660795 A  ERRORERROR'
2019-03-21 16:17:40 [DEBUG   ] Got command RPT from MCS: ref #92568
2019-03-21 16:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92568  77 58563 58660795 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:17:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:17:51 [DEBUG   ] Got command BAM from MCS: ref #92590
2019-03-21 16:17:51 [INFO    ] Finished processing BAM request
2019-03-21 16:17:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:17:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92590   8 58563 58671027 A  ERROR'
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:17:51 [DEBUG   ] spawn_process: at 2019-03-21 16:17:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:18:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:18:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:18:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:18:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:18:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:18:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:18:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:18:01 [DEBUG   ] Finished updating board flags in 1.102 seconds
2019-03-21 16:18:04 [DEBUG   ] Got command BAM from MCS: ref #92591
2019-03-21 16:18:04 [INFO    ] Finished processing BAM request
2019-03-21 16:18:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92591   8 58563 58684031 A  ERROR'
2019-03-21 16:18:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:18:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:18:04 [DEBUG   ] spawn_process: at 2019-03-21 16:18:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:18:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:18:31 [DEBUG   ] Got command BAM from MCS: ref #92592
2019-03-21 16:18:31 [INFO    ] Finished processing BAM request
2019-03-21 16:18:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92592   8 58563 58711027 A  ERROR'
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:18:31 [DEBUG   ] spawn_process: at 2019-03-21 16:18:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:18:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:19:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:19:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:19:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 16:19:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:19:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:19:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:19:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:19:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:19:01 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-03-21 16:19:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:19:12 [DEBUG   ] Got command BAM from MCS: ref #92593
2019-03-21 16:19:12 [INFO    ] Finished processing BAM request
2019-03-21 16:19:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:19:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92593   8 58563 58752035 A  ERROR'
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:19:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:19:12 [DEBUG   ] spawn_process: at 2019-03-21 16:19:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:19:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:19:44 [DEBUG   ] Got command BAM from MCS: ref #92594
2019-03-21 16:19:44 [INFO    ] Finished processing BAM request
2019-03-21 16:19:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:19:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92594   8 58563 58784031 A  ERROR'
2019-03-21 16:19:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:19:44 [DEBUG   ] spawn_process: at 2019-03-21 16:19:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:19:54 [DEBUG   ] Got command BAM from MCS: ref #92595
2019-03-21 16:19:54 [INFO    ] Finished processing BAM request
2019-03-21 16:19:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92595   8 58563 58794031 A  ERROR'
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:19:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:19:54 [DEBUG   ] spawn_process: at 2019-03-21 16:19:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:20:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:20:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 16:20:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:20:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:20:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:20:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:20:02 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-03-21 16:20:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:20:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:20:36 [DEBUG   ] Got command BAM from MCS: ref #92596
2019-03-21 16:20:36 [INFO    ] Finished processing BAM request
2019-03-21 16:20:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:20:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92596   8 58563 58836031 A  ERROR'
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:20:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:20:36 [DEBUG   ] spawn_process: at 2019-03-21 16:20:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:20:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 16:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-03-21 16:21:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:21:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:21:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:21:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:21:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:21:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:21:01 [DEBUG   ] Finished updating board flags in 1.248 seconds
2019-03-21 16:21:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:21:19 [DEBUG   ] Got command BAM from MCS: ref #92603
2019-03-21 16:21:19 [INFO    ] Finished processing BAM request
2019-03-21 16:21:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:21:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92603   8 58563 58879031 A  ERROR'
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:21:19 [DEBUG   ] spawn_process: at 2019-03-21 16:21:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:21:22 [DEBUG   ] Got command BAM from MCS: ref #92604
2019-03-21 16:21:22 [INFO    ] Finished processing BAM request
2019-03-21 16:21:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92604   8 58563 58882023 A  ERROR'
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:21:22 [DEBUG   ] spawn_process: at 2019-03-21 16:21:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:21:23 [DEBUG   ] spawn_process: at 2019-03-21 16:21:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:21:23 [DEBUG   ] spawn_process: at 2019-03-21 16:21:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:21:23 [DEBUG   ] spawn_process: at 2019-03-21 16:21:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:21:23 [DEBUG   ] spawn_process: at 2019-03-21 16:21:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:21:23 [DEBUG   ] spawn_process: at 2019-03-21 16:21:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:21:23 [DEBUG   ] spawn_process: at 2019-03-21 16:21:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:21:23 [DEBUG   ] spawn_process: at 2019-03-21 16:21:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:21:23 [DEBUG   ] spawn_process: at 2019-03-21 16:21:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:21:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:21:41 [DEBUG   ] Got command RPT from MCS: ref #92605
2019-03-21 16:21:41 [DEBUG   ] summary = ERROR
2019-03-21 16:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92605  13 58563 58901515 A  ERRORERROR'
2019-03-21 16:21:41 [DEBUG   ] Got command RPT from MCS: ref #92606
2019-03-21 16:21:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92606  77 58563 58901707 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:21:41 [DEBUG   ] Got command RPT from MCS: ref #92607
2019-03-21 16:21:41 [DEBUG   ] summary = ERROR
2019-03-21 16:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92607  13 58563 58901911 A  ERRORERROR'
2019-03-21 16:21:42 [DEBUG   ] Got command RPT from MCS: ref #92608
2019-03-21 16:21:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92608  77 58563 58902115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:21:42 [DEBUG   ] Got command RPT from MCS: ref #92609
2019-03-21 16:21:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92609  12 58563 58902307 A  ERRORB¡ff'
2019-03-21 16:21:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 16:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:22:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:22:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:22:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:22:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:22:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:22:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:22:01 [DEBUG   ] Finished updating board flags in 1.095 seconds
2019-03-21 16:22:03 [DEBUG   ] Got command BAM from MCS: ref #92610
2019-03-21 16:22:03 [INFO    ] Finished processing BAM request
2019-03-21 16:22:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:22:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92610   8 58563 58923027 A  ERROR'
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:22:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:22:03 [DEBUG   ] spawn_process: at 2019-03-21 16:22:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:22:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 16:22:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:22:40 [DEBUG   ] Got command RPT from MCS: ref #92611
2019-03-21 16:22:40 [DEBUG   ] summary = ERROR
2019-03-21 16:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92611  13 58563 58960791 A  ERRORERROR'
2019-03-21 16:22:40 [DEBUG   ] Got command RPT from MCS: ref #92612
2019-03-21 16:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92612  77 58563 58960791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:22:44 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:22:48 [DEBUG   ] Got command BAM from MCS: ref #92628
2019-03-21 16:22:48 [INFO    ] Finished processing BAM request
2019-03-21 16:22:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:22:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92628   8 58563 58968031 A  ERROR'
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:22:48 [DEBUG   ] spawn_process: at 2019-03-21 16:22:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:22:58 [DEBUG   ] Got command BAM from MCS: ref #92629
2019-03-21 16:22:58 [INFO    ] Finished processing BAM request
2019-03-21 16:22:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:22:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92629   8 58563 58978031 A  ERROR'
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:22:58 [DEBUG   ] spawn_process: at 2019-03-21 16:22:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:23:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:23:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:23:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:23:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:23:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:23:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:23:01 [DEBUG   ] Finished updating board flags in 1.002 seconds
2019-03-21 16:23:05 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 16:23:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:23:34 [DEBUG   ] Got command BAM from MCS: ref #92630
2019-03-21 16:23:34 [INFO    ] Finished processing BAM request
2019-03-21 16:23:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92630   8 58563 59014035 A  ERROR'
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:23:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:23:34 [DEBUG   ] spawn_process: at 2019-03-21 16:23:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:23:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:24:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:24:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:24:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 16:24:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:24:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:24:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:24:01 [WARNING ] (13, 1, 'bot')
2019-03-21 16:24:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:24:01 [DEBUG   ] Finished updating board flags in 0.993 seconds
2019-03-21 16:24:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:24:21 [DEBUG   ] Got command BAM from MCS: ref #92637
2019-03-21 16:24:21 [INFO    ] Finished processing BAM request
2019-03-21 16:24:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:24:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92637   8 58563 59061031 A  ERROR'
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:24:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:24:21 [DEBUG   ] spawn_process: at 2019-03-21 16:24:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:24:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:24:32 [DEBUG   ] Got command BAM from MCS: ref #92638
2019-03-21 16:24:32 [INFO    ] Finished processing BAM request
2019-03-21 16:24:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92638   8 58563 59072027 A  ERROR'
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:24:32 [DEBUG   ] spawn_process: at 2019-03-21 16:24:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:24:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:25:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-03-21 16:25:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:25:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:25:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:25:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:25:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:25:02 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-03-21 16:25:05 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-21 16:25:10 [DEBUG   ] Got command BAM from MCS: ref #92639
2019-03-21 16:25:10 [INFO    ] Finished processing BAM request
2019-03-21 16:25:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92639   8 58563 59110023 A  ERROR'
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:25:10 [DEBUG   ] spawn_process: at 2019-03-21 16:25:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:25:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:25:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:26:00 [DEBUG   ] Got command BAM from MCS: ref #92640
2019-03-21 16:26:00 [INFO    ] Finished processing BAM request
2019-03-21 16:26:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92640   8 58563 59160031 A  ERROR'
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:26:00 [DEBUG   ] spawn_process: at 2019-03-21 16:26:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:26:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-03-21 16:26:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:26:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:26:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:26:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:26:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:26:02 [DEBUG   ] Finished updating board flags in 1.320 seconds
2019-03-21 16:26:05 [DEBUG   ] Got command BAM from MCS: ref #92641
2019-03-21 16:26:05 [INFO    ] Finished processing BAM request
2019-03-21 16:26:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92641   8 58563 59165031 A  ERROR'
2019-03-21 16:26:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:26:05 [DEBUG   ] spawn_process: at 2019-03-21 16:26:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:26:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:26:41 [DEBUG   ] Got command RPT from MCS: ref #92644
2019-03-21 16:26:41 [DEBUG   ] summary = ERROR
2019-03-21 16:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92644  13 58563 59201599 A  ERRORERROR'
2019-03-21 16:26:41 [DEBUG   ] Got command RPT from MCS: ref #92645
2019-03-21 16:26:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92645  77 58563 59201791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:26:41 [DEBUG   ] Got command RPT from MCS: ref #92646
2019-03-21 16:26:41 [DEBUG   ] summary = ERROR
2019-03-21 16:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92646  13 58563 59201995 A  ERRORERROR'
2019-03-21 16:26:42 [DEBUG   ] Got command RPT from MCS: ref #92648
2019-03-21 16:26:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92648  77 58563 59202199 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:26:42 [DEBUG   ] Got command RPT from MCS: ref #92649
2019-03-21 16:26:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92649  12 58563 59202403 A  ERRORB ff'
2019-03-21 16:26:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:26:51 [DEBUG   ] Got command BAM from MCS: ref #92660
2019-03-21 16:26:51 [INFO    ] Finished processing BAM request
2019-03-21 16:26:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92660   8 58563 59211023 A  ERROR'
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:26:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:26:51 [DEBUG   ] spawn_process: at 2019-03-21 16:26:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:27:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 16:27:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:27:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:27:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:27:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:27:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:27:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:27:02 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-03-21 16:27:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:27:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:27:36 [DEBUG   ] Got command BAM from MCS: ref #92661
2019-03-21 16:27:36 [INFO    ] Finished processing BAM request
2019-03-21 16:27:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92661   8 58563 59256023 A  ERROR'
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:27:36 [DEBUG   ] spawn_process: at 2019-03-21 16:27:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:27:40 [DEBUG   ] Got command RPT from MCS: ref #92662
2019-03-21 16:27:40 [DEBUG   ] summary = ERROR
2019-03-21 16:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92662  13 58563 59260799 A  ERRORERROR'
2019-03-21 16:27:40 [DEBUG   ] Got command RPT from MCS: ref #92663
2019-03-21 16:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92663  77 58563 59260799 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:27:43 [DEBUG   ] Got command BAM from MCS: ref #92679
2019-03-21 16:27:43 [INFO    ] Finished processing BAM request
2019-03-21 16:27:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92679   8 58563 59263023 A  ERROR'
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:27:43 [DEBUG   ] spawn_process: at 2019-03-21 16:27:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:27:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:28:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:28:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:28:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 16:28:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:28:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:28:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:28:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:28:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:28:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:28:02 [DEBUG   ] Finished updating board flags in 1.199 seconds
2019-03-21 16:28:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:28:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:28:37 [DEBUG   ] Got command BAM from MCS: ref #92680
2019-03-21 16:28:37 [INFO    ] Finished processing BAM request
2019-03-21 16:28:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92680   8 58563 59317035 A  ERROR'
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:28:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:28:37 [DEBUG   ] spawn_process: at 2019-03-21 16:28:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:28:45 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 16:29:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:29:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:29:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 16:29:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:29:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:29:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:29:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:29:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:29:02 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-03-21 16:29:05 [DEBUG   ] Got command BAM from MCS: ref #92681
2019-03-21 16:29:05 [INFO    ] Finished processing BAM request
2019-03-21 16:29:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92681   8 58563 59345023 A  ERROR'
2019-03-21 16:29:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:29:05 [DEBUG   ] spawn_process: at 2019-03-21 16:29:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:29:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:29:32 [DEBUG   ] Got command BAM from MCS: ref #92682
2019-03-21 16:29:32 [INFO    ] Finished processing BAM request
2019-03-21 16:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92682   8 58563 59372023 A  ERROR'
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:29:32 [DEBUG   ] spawn_process: at 2019-03-21 16:29:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:29:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:30:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:30:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:30:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:30:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:30:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:30:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:30:02 [DEBUG   ] Finished updating board flags in 1.216 seconds
2019-03-21 16:30:05 [DEBUG   ] Finished updating ant stats in 0.388 seconds
2019-03-21 16:30:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:30:29 [DEBUG   ] Got command BAM from MCS: ref #92689
2019-03-21 16:30:29 [INFO    ] Finished processing BAM request
2019-03-21 16:30:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92689   8 58563 59429023 A  ERROR'
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:30:29 [DEBUG   ] spawn_process: at 2019-03-21 16:30:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:30:33 [DEBUG   ] Got command BAM from MCS: ref #92690
2019-03-21 16:30:33 [INFO    ] Finished processing BAM request
2019-03-21 16:30:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:30:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92690   8 58563 59433035 A  ERROR'
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:30:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:30:33 [DEBUG   ] spawn_process: at 2019-03-21 16:30:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:30:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:31:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:31:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:31:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:31:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:31:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:31:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:31:02 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-03-21 16:31:06 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 16:31:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:31:28 [DEBUG   ] Got command BAM from MCS: ref #92691
2019-03-21 16:31:28 [INFO    ] Finished processing BAM request
2019-03-21 16:31:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:31:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92691   8 58563 59488027 A  ERROR'
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:31:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:31:28 [DEBUG   ] spawn_process: at 2019-03-21 16:31:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:31:41 [DEBUG   ] Got command RPT from MCS: ref #92692
2019-03-21 16:31:41 [DEBUG   ] summary = ERROR
2019-03-21 16:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92692  13 58563 59501683 A  ERRORERROR'
2019-03-21 16:31:41 [DEBUG   ] Got command RPT from MCS: ref #92693
2019-03-21 16:31:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92693  77 58563 59501875 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:31:42 [DEBUG   ] Got command RPT from MCS: ref #92694
2019-03-21 16:31:42 [DEBUG   ] summary = ERROR
2019-03-21 16:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92694  13 58563 59502079 A  ERRORERROR'
2019-03-21 16:31:42 [DEBUG   ] Got command RPT from MCS: ref #92695
2019-03-21 16:31:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92695  77 58563 59502283 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:31:42 [DEBUG   ] Got command RPT from MCS: ref #92696
2019-03-21 16:31:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92696  12 58563 59502475 A  ERRORB ff'
2019-03-21 16:31:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:32:00 [DEBUG   ] Got command BAM from MCS: ref #92697
2019-03-21 16:32:00 [INFO    ] Finished processing BAM request
2019-03-21 16:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92697   8 58563 59520027 A  ERROR'
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:32:00 [DEBUG   ] spawn_process: at 2019-03-21 16:32:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:32:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:32:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:32:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 16:32:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:32:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:32:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:32:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:32:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:32:03 [DEBUG   ] Finished updating board flags in 1.965 seconds
2019-03-21 16:32:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:32:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:32:28 [DEBUG   ] Got command BAM from MCS: ref #92698
2019-03-21 16:32:28 [INFO    ] Finished processing BAM request
2019-03-21 16:32:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92698   8 58563 59548027 A  ERROR'
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:32:28 [DEBUG   ] spawn_process: at 2019-03-21 16:32:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:32:40 [DEBUG   ] Got command RPT from MCS: ref #92699
2019-03-21 16:32:40 [DEBUG   ] summary = ERROR
2019-03-21 16:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92699  13 58563 59560799 A  ERRORERROR'
2019-03-21 16:32:40 [DEBUG   ] Got command RPT from MCS: ref #92700
2019-03-21 16:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92700  77 58563 59560799 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:32:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:33:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:33:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:33:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:33:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:33:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:33:03 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-03-21 16:33:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:33:25 [DEBUG   ] Got command BAM from MCS: ref #92722
2019-03-21 16:33:25 [INFO    ] Finished processing BAM request
2019-03-21 16:33:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92722   8 58563 59605031 A  ERROR'
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:33:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:33:25 [DEBUG   ] spawn_process: at 2019-03-21 16:33:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:33:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:33:30 [DEBUG   ] Got command BAM from MCS: ref #92723
2019-03-21 16:33:30 [INFO    ] Finished processing BAM request
2019-03-21 16:33:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92723   8 58563 59610035 A  ERROR'
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:33:30 [DEBUG   ] spawn_process: at 2019-03-21 16:33:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:33:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:34:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:34:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 16:34:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:34:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:34:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:34:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:34:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:34:02 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-03-21 16:34:06 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 16:34:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:34:34 [DEBUG   ] Got command BAM from MCS: ref #92724
2019-03-21 16:34:34 [INFO    ] Finished processing BAM request
2019-03-21 16:34:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92724   8 58563 59674043 A  ERROR'
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:34:34 [DEBUG   ] spawn_process: at 2019-03-21 16:34:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:34:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:34:49 [DEBUG   ] Got command BAM from MCS: ref #92725
2019-03-21 16:34:49 [INFO    ] Finished processing BAM request
2019-03-21 16:34:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92725   8 58563 59689031 A  ERROR'
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:34:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:34:49 [DEBUG   ] spawn_process: at 2019-03-21 16:34:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:35:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:35:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:35:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:35:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:35:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:35:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:35:02 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-03-21 16:35:06 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 16:35:26 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:35:40 [DEBUG   ] Got command BAM from MCS: ref #92726
2019-03-21 16:35:40 [INFO    ] Finished processing BAM request
2019-03-21 16:35:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92726   8 58563 59740027 A  ERROR'
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:35:40 [DEBUG   ] spawn_process: at 2019-03-21 16:35:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:35:46 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-21 16:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:36:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:36:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:36:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:36:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:36:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:36:02 [DEBUG   ] Finished updating board flags in 1.002 seconds
2019-03-21 16:36:06 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:36:12 [DEBUG   ] Got command BAM from MCS: ref #92733
2019-03-21 16:36:12 [INFO    ] Finished processing BAM request
2019-03-21 16:36:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92733   8 58563 59772031 A  ERROR'
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:36:12 [DEBUG   ] spawn_process: at 2019-03-21 16:36:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:36:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:36:41 [DEBUG   ] Got command RPT from MCS: ref #92736
2019-03-21 16:36:41 [DEBUG   ] summary = ERROR
2019-03-21 16:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92736  13 58563 59801767 A  ERRORERROR'
2019-03-21 16:36:41 [DEBUG   ] Got command RPT from MCS: ref #92737
2019-03-21 16:36:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92737  77 58563 59801959 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:36:42 [DEBUG   ] Got command RPT from MCS: ref #92738
2019-03-21 16:36:42 [DEBUG   ] summary = ERROR
2019-03-21 16:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92738  13 58563 59802163 A  ERRORERROR'
2019-03-21 16:36:42 [DEBUG   ] Got command RPT from MCS: ref #92740
2019-03-21 16:36:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92740  77 58563 59802367 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:36:42 [DEBUG   ] Got command RPT from MCS: ref #92741
2019-03-21 16:36:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92741  12 58563 59802571 A  ERRORB¡ff'
2019-03-21 16:36:46 [DEBUG   ] Got command BAM from MCS: ref #92746
2019-03-21 16:36:46 [INFO    ] Finished processing BAM request
2019-03-21 16:36:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92746   8 58563 59806031 A  ERROR'
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:36:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:36:46 [DEBUG   ] spawn_process: at 2019-03-21 16:36:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:36:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:37:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-03-21 16:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:37:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:37:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:37:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:37:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:37:02 [WARNING ] (13, 1, 'bot')
2019-03-21 16:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:37:02 [DEBUG   ] Finished updating board flags in 1.000 seconds
2019-03-21 16:37:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 16:37:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:37:33 [DEBUG   ] Got command BAM from MCS: ref #92747
2019-03-21 16:37:33 [INFO    ] Finished processing BAM request
2019-03-21 16:37:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92747   8 58563 59853023 A  ERROR'
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:37:33 [DEBUG   ] spawn_process: at 2019-03-21 16:37:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:37:40 [DEBUG   ] Got command RPT from MCS: ref #92748
2019-03-21 16:37:40 [DEBUG   ] summary = ERROR
2019-03-21 16:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92748  13 58563 59860791 A  ERRORERROR'
2019-03-21 16:37:40 [DEBUG   ] Got command RPT from MCS: ref #92749
2019-03-21 16:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92749  77 58563 59860791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:37:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 16:37:52 [DEBUG   ] Got command BAM from MCS: ref #92765
2019-03-21 16:37:52 [INFO    ] Finished processing BAM request
2019-03-21 16:37:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:37:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92765   8 58563 59872027 A  ERROR'
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:37:52 [DEBUG   ] spawn_process: at 2019-03-21 16:37:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:38:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:38:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:38:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:38:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:38:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:38:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:38:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:38:03 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-03-21 16:38:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 16:38:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:38:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:38:53 [DEBUG   ] Got command BAM from MCS: ref #92772
2019-03-21 16:38:53 [INFO    ] Finished processing BAM request
2019-03-21 16:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92772   8 58563 59933031 A  ERROR'
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:38:53 [DEBUG   ] spawn_process: at 2019-03-21 16:38:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:38:58 [DEBUG   ] Got command BAM from MCS: ref #92773
2019-03-21 16:38:58 [INFO    ] Finished processing BAM request
2019-03-21 16:38:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92773   8 58563 59938027 A  ERROR'
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:38:58 [DEBUG   ] spawn_process: at 2019-03-21 16:38:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:39:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:39:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:39:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:39:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:39:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:39:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:39:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:39:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:39:03 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-03-21 16:39:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 16:39:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 16:39:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 16:40:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:40:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:40:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:40:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:40:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:40:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:40:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:40:03 [DEBUG   ] Finished updating board flags in 1.099 seconds
2019-03-21 16:40:04 [DEBUG   ] Got command BAM from MCS: ref #92774
2019-03-21 16:40:04 [INFO    ] Finished processing BAM request
2019-03-21 16:40:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92774   8 58563 60004031 A  ERROR'
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:40:04 [DEBUG   ] spawn_process: at 2019-03-21 16:40:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:40:07 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 16:40:12 [DEBUG   ] Got command BAM from MCS: ref #92775
2019-03-21 16:40:12 [INFO    ] Finished processing BAM request
2019-03-21 16:40:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92775   8 58563 60012027 A  ERROR'
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:40:12 [DEBUG   ] spawn_process: at 2019-03-21 16:40:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:40:27 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 16:40:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 16:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 16:41:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:41:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:41:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:41:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:41:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:41:04 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-03-21 16:41:07 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 16:41:10 [DEBUG   ] Got command BAM from MCS: ref #92776
2019-03-21 16:41:10 [INFO    ] Finished processing BAM request
2019-03-21 16:41:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92776   8 58563 60070027 A  ERROR'
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:41:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:41:10 [DEBUG   ] spawn_process: at 2019-03-21 16:41:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:41:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:41:30 [DEBUG   ] Got command BAM from MCS: ref #92777
2019-03-21 16:41:30 [INFO    ] Finished processing BAM request
2019-03-21 16:41:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92777   8 58563 60090023 A  ERROR'
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:41:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:41:30 [DEBUG   ] spawn_process: at 2019-03-21 16:41:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:41:41 [DEBUG   ] Got command RPT from MCS: ref #92778
2019-03-21 16:41:41 [DEBUG   ] summary = ERROR
2019-03-21 16:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92778  13 58563 60101855 A  ERRORERROR'
2019-03-21 16:41:42 [DEBUG   ] Got command RPT from MCS: ref #92779
2019-03-21 16:41:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92779  77 58563 60102047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:41:42 [DEBUG   ] Got command RPT from MCS: ref #92780
2019-03-21 16:41:42 [DEBUG   ] summary = ERROR
2019-03-21 16:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92780  13 58563 60102251 A  ERRORERROR'
2019-03-21 16:41:42 [DEBUG   ] Got command RPT from MCS: ref #92781
2019-03-21 16:41:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92781  77 58563 60102455 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:41:42 [DEBUG   ] Got command RPT from MCS: ref #92782
2019-03-21 16:41:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92782  12 58563 60102659 A  ERRORB¡ff'
2019-03-21 16:41:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 16:42:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:42:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:42:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:42:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:42:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:42:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:42:03 [DEBUG   ] Finished updating board flags in 1.171 seconds
2019-03-21 16:42:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 16:42:16 [DEBUG   ] Got command BAM from MCS: ref #92789
2019-03-21 16:42:16 [INFO    ] Finished processing BAM request
2019-03-21 16:42:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:42:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92789   8 58563 60136027 A  ERROR'
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:42:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:42:16 [DEBUG   ] spawn_process: at 2019-03-21 16:42:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:42:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:42:40 [DEBUG   ] Got command RPT from MCS: ref #92790
2019-03-21 16:42:40 [DEBUG   ] summary = ERROR
2019-03-21 16:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92790  13 58563 60160791 A  ERRORERROR'
2019-03-21 16:42:40 [DEBUG   ] Got command RPT from MCS: ref #92791
2019-03-21 16:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92791  77 58563 60160791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:42:47 [DEBUG   ] Got command BAM from MCS: ref #92807
2019-03-21 16:42:47 [INFO    ] Finished processing BAM request
2019-03-21 16:42:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:42:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92807   8 58563 60167027 A  ERROR'
2019-03-21 16:42:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:42:47 [DEBUG   ] spawn_process: at 2019-03-21 16:42:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:43:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 16:43:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 16:43:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:43:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:43:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:43:03 [WARNING ] (13, 1, 'bot')
2019-03-21 16:43:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:43:03 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-03-21 16:43:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:43:22 [DEBUG   ] Got command BAM from MCS: ref #92808
2019-03-21 16:43:22 [INFO    ] Finished processing BAM request
2019-03-21 16:43:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92808   8 58563 60202031 A  ERROR'
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:43:22 [DEBUG   ] spawn_process: at 2019-03-21 16:43:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:43:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:43:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 16:44:03 [DEBUG   ] Got command BAM from MCS: ref #92809
2019-03-21 16:44:03 [INFO    ] Finished processing BAM request
2019-03-21 16:44:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:44:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92809   8 58563 60243039 A  ERROR'
2019-03-21 16:44:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 16:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:44:03 [DEBUG   ] spawn_process: at 2019-03-21 16:44:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:44:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:44:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:44:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:44:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:44:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:44:04 [DEBUG   ] Finished updating board flags in 1.551 seconds
2019-03-21 16:44:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:44:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:44:28 [DEBUG   ] Got command BAM from MCS: ref #92810
2019-03-21 16:44:28 [INFO    ] Finished processing BAM request
2019-03-21 16:44:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:44:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92810   8 58563 60268027 A  ERROR'
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:44:28 [DEBUG   ] spawn_process: at 2019-03-21 16:44:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:44:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 16:45:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-03-21 16:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:45:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:45:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:45:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:45:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:45:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:45:04 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-03-21 16:45:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:45:18 [DEBUG   ] Got command BAM from MCS: ref #92817
2019-03-21 16:45:18 [INFO    ] Finished processing BAM request
2019-03-21 16:45:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92817   8 58563 60318023 A  ERROR'
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:45:18 [DEBUG   ] spawn_process: at 2019-03-21 16:45:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:45:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:45:33 [DEBUG   ] Got command BAM from MCS: ref #92818
2019-03-21 16:45:33 [INFO    ] Finished processing BAM request
2019-03-21 16:45:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:45:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92818   8 58563 60333027 A  ERROR'
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:45:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:45:33 [DEBUG   ] spawn_process: at 2019-03-21 16:45:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:45:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:46:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:46:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 16:46:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:46:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:46:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:46:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:46:04 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-03-21 16:46:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:46:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:46:32 [DEBUG   ] Got command BAM from MCS: ref #92819
2019-03-21 16:46:32 [INFO    ] Finished processing BAM request
2019-03-21 16:46:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:46:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92819   8 58563 60392031 A  ERROR'
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:46:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:46:32 [DEBUG   ] spawn_process: at 2019-03-21 16:46:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:46:38 [DEBUG   ] Got command BAM from MCS: ref #92820
2019-03-21 16:46:38 [INFO    ] Finished processing BAM request
2019-03-21 16:46:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92820   8 58563 60398027 A  ERROR'
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:46:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:46:38 [DEBUG   ] spawn_process: at 2019-03-21 16:46:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:46:41 [DEBUG   ] Got command RPT from MCS: ref #92823
2019-03-21 16:46:41 [DEBUG   ] summary = ERROR
2019-03-21 16:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92823  13 58563 60401935 A  ERRORERROR'
2019-03-21 16:46:42 [DEBUG   ] Got command RPT from MCS: ref #92824
2019-03-21 16:46:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92824  77 58563 60402139 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:46:42 [DEBUG   ] Got command RPT from MCS: ref #92825
2019-03-21 16:46:42 [DEBUG   ] summary = ERROR
2019-03-21 16:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92825  13 58563 60402343 A  ERRORERROR'
2019-03-21 16:46:42 [DEBUG   ] Got command RPT from MCS: ref #92827
2019-03-21 16:46:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92827  77 58563 60402535 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:46:42 [DEBUG   ] Got command RPT from MCS: ref #92828
2019-03-21 16:46:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92828  12 58563 60402739 A  ERRORB¡ff'
2019-03-21 16:46:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:47:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:47:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2019-03-21 16:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-03-21 16:47:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 16:47:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:47:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:47:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:47:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:47:04 [DEBUG   ] Finished updating board flags in 1.200 seconds
2019-03-21 16:47:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:47:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:47:40 [DEBUG   ] Got command RPT from MCS: ref #92833
2019-03-21 16:47:40 [DEBUG   ] summary = ERROR
2019-03-21 16:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92833  13 58563 60460799 A  ERRORERROR'
2019-03-21 16:47:40 [DEBUG   ] Got command RPT from MCS: ref #92834
2019-03-21 16:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92834  77 58563 60460799 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:47:43 [DEBUG   ] Got command BAM from MCS: ref #92850
2019-03-21 16:47:43 [INFO    ] Finished processing BAM request
2019-03-21 16:47:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92850   8 58563 60463023 A  ERROR'
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:47:43 [DEBUG   ] spawn_process: at 2019-03-21 16:47:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:47:45 [DEBUG   ] Got command BAM from MCS: ref #92854
2019-03-21 16:47:45 [INFO    ] Finished processing BAM request
2019-03-21 16:47:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:47:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92854   8 58563 60465035 A  ERROR'
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:47:45 [DEBUG   ] spawn_process: at 2019-03-21 16:47:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:47:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 16:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:48:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:48:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:48:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:48:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:48:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:48:04 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-03-21 16:48:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:48:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:48:48 [DEBUG   ] Got command BAM from MCS: ref #92858
2019-03-21 16:48:48 [INFO    ] Finished processing BAM request
2019-03-21 16:48:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92858   8 58563 60528027 A  ERROR'
2019-03-21 16:48:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:48:48 [DEBUG   ] spawn_process: at 2019-03-21 16:48:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:48:57 [DEBUG   ] Got command BAM from MCS: ref #92859
2019-03-21 16:48:57 [INFO    ] Finished processing BAM request
2019-03-21 16:48:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92859   8 58563 60537031 A  ERROR'
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:48:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:48:57 [DEBUG   ] spawn_process: at 2019-03-21 16:48:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:49:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:49:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:49:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:49:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:49:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:49:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:49:04 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-03-21 16:49:08 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2019-03-21 16:49:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:49:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:49:53 [DEBUG   ] Got command BAM from MCS: ref #92860
2019-03-21 16:49:53 [INFO    ] Finished processing BAM request
2019-03-21 16:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92860   8 58563 60593027 A  ERROR'
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:49:53 [DEBUG   ] spawn_process: at 2019-03-21 16:49:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:50:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:50:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:50:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:50:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:50:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:50:05 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-03-21 16:50:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:50:09 [DEBUG   ] Got command BAM from MCS: ref #92861
2019-03-21 16:50:09 [INFO    ] Finished processing BAM request
2019-03-21 16:50:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92861   8 58563 60609035 A  ERROR'
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:50:09 [DEBUG   ] spawn_process: at 2019-03-21 16:50:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:50:28 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 16:50:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:50:58 [DEBUG   ] Got command BAM from MCS: ref #92868
2019-03-21 16:50:58 [INFO    ] Finished processing BAM request
2019-03-21 16:50:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92868   8 58563 60658031 A  ERROR'
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:50:58 [DEBUG   ] spawn_process: at 2019-03-21 16:50:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:51:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:51:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:51:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:51:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:51:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:51:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:51:04 [DEBUG   ] Finished updating board flags in 1.049 seconds
2019-03-21 16:51:08 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 16:51:20 [DEBUG   ] Got command BAM from MCS: ref #92869
2019-03-21 16:51:20 [INFO    ] Finished processing BAM request
2019-03-21 16:51:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:51:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92869   8 58563 60680027 A  ERROR'
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:51:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:51:20 [DEBUG   ] spawn_process: at 2019-03-21 16:51:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:51:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-21 16:51:42 [DEBUG   ] Got command RPT from MCS: ref #92870
2019-03-21 16:51:42 [DEBUG   ] summary = ERROR
2019-03-21 16:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92870  13 58563 60702023 A  ERRORERROR'
2019-03-21 16:51:42 [DEBUG   ] Got command RPT from MCS: ref #92871
2019-03-21 16:51:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92871  77 58563 60702227 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:51:42 [DEBUG   ] Got command RPT from MCS: ref #92872
2019-03-21 16:51:42 [DEBUG   ] summary = ERROR
2019-03-21 16:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92872  13 58563 60702431 A  ERRORERROR'
2019-03-21 16:51:42 [DEBUG   ] Got command RPT from MCS: ref #92873
2019-03-21 16:51:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92873  77 58563 60702623 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:51:42 [DEBUG   ] Got command RPT from MCS: ref #92874
2019-03-21 16:51:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92874  12 58563 60702827 A  ERRORB¡ff'
2019-03-21 16:51:48 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:52:03 [DEBUG   ] Got command BAM from MCS: ref #92875
2019-03-21 16:52:03 [INFO    ] Finished processing BAM request
2019-03-21 16:52:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:52:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92875   8 58563 60723027 A  ERROR'
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:52:03 [DEBUG   ] spawn_process: at 2019-03-21 16:52:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:52:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:52:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:52:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:52:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:52:04 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-03-21 16:52:09 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 16:52:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:52:30 [DEBUG   ] Got command BAM from MCS: ref #92876
2019-03-21 16:52:30 [INFO    ] Finished processing BAM request
2019-03-21 16:52:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92876   8 58563 60750031 A  ERROR'
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:52:30 [DEBUG   ] spawn_process: at 2019-03-21 16:52:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:52:40 [DEBUG   ] Got command RPT from MCS: ref #92877
2019-03-21 16:52:40 [DEBUG   ] summary = ERROR
2019-03-21 16:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92877  13 58563 60760795 A  ERRORERROR'
2019-03-21 16:52:40 [DEBUG   ] Got command RPT from MCS: ref #92878
2019-03-21 16:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92878  77 58563 60760795 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:52:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 16:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:53:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:53:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:53:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:53:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:53:04 [WARNING ] (13, 1, 'bot')
2019-03-21 16:53:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:53:04 [DEBUG   ] Finished updating board flags in 0.996 seconds
2019-03-21 16:53:08 [DEBUG   ] Got command BAM from MCS: ref #92894
2019-03-21 16:53:08 [INFO    ] Finished processing BAM request
2019-03-21 16:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92894   8 58563 60788027 A  ERROR'
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:53:08 [DEBUG   ] spawn_process: at 2019-03-21 16:53:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:53:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 16:53:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:53:39 [DEBUG   ] Got command BAM from MCS: ref #92895
2019-03-21 16:53:39 [INFO    ] Finished processing BAM request
2019-03-21 16:53:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92895   8 58563 60819027 A  ERROR'
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:53:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:53:39 [DEBUG   ] spawn_process: at 2019-03-21 16:53:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:53:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 16:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:54:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:54:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:54:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:54:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:54:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:54:05 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-03-21 16:54:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:54:13 [DEBUG   ] Got command BAM from MCS: ref #92902
2019-03-21 16:54:13 [INFO    ] Finished processing BAM request
2019-03-21 16:54:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92902   8 58563 60853027 A  ERROR'
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:54:13 [DEBUG   ] spawn_process: at 2019-03-21 16:54:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:54:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:54:47 [DEBUG   ] Got command BAM from MCS: ref #92903
2019-03-21 16:54:47 [INFO    ] Finished processing BAM request
2019-03-21 16:54:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92903   8 58563 60887031 A  ERROR'
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 16:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 16:54:47 [DEBUG   ] spawn_process: at 2019-03-21 16:54:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 16:54:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 16:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-03-21 16:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:55:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:55:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:55:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:55:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:55:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:55:05 [DEBUG   ] Finished updating board flags in 1.339 seconds
2019-03-21 16:55:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:55:18 [DEBUG   ] Got command BAM from MCS: ref #92904
2019-03-21 16:55:18 [INFO    ] Finished processing BAM request
2019-03-21 16:55:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92904   8 58563 60918035 A  ERROR'
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:55:18 [DEBUG   ] spawn_process: at 2019-03-21 16:55:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:55:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:55:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:55:55 [DEBUG   ] Got command BAM from MCS: ref #92905
2019-03-21 16:55:55 [INFO    ] Finished processing BAM request
2019-03-21 16:55:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:55:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92905   8 58563 60955023 A  ERROR'
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:55:55 [DEBUG   ] spawn_process: at 2019-03-21 16:55:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:56:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:56:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:56:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:56:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:56:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:56:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:56:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:56:05 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-03-21 16:56:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:56:23 [DEBUG   ] Got command BAM from MCS: ref #92906
2019-03-21 16:56:23 [INFO    ] Finished processing BAM request
2019-03-21 16:56:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:56:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92906   8 58563 60983023 A  ERROR'
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:56:23 [DEBUG   ] spawn_process: at 2019-03-21 16:56:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:56:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:56:42 [DEBUG   ] Got command RPT from MCS: ref #92909
2019-03-21 16:56:42 [DEBUG   ] summary = ERROR
2019-03-21 16:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92909  13 58563 61002115 A  ERRORERROR'
2019-03-21 16:56:42 [DEBUG   ] Got command RPT from MCS: ref #92910
2019-03-21 16:56:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92910  77 58563 61002307 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:56:42 [DEBUG   ] Got command RPT from MCS: ref #92911
2019-03-21 16:56:42 [DEBUG   ] summary = ERROR
2019-03-21 16:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92911  13 58563 61002511 A  ERRORERROR'
2019-03-21 16:56:42 [DEBUG   ] Got command RPT from MCS: ref #92913
2019-03-21 16:56:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92913  77 58563 61002715 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:56:42 [DEBUG   ] Got command RPT from MCS: ref #92914
2019-03-21 16:56:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 16:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92914  12 58563 61002919 A  ERRORB ff'
2019-03-21 16:56:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:57:02 [DEBUG   ] Got command BAM from MCS: ref #92925
2019-03-21 16:57:02 [INFO    ] Finished processing BAM request
2019-03-21 16:57:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92925   8 58563 61022027 A  ERROR'
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 16:57:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 16:57:02 [DEBUG   ] spawn_process: at 2019-03-21 16:57:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 16:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:57:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:57:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:57:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:57:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:57:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:57:05 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-03-21 16:57:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:57:28 [DEBUG   ] Got command BAM from MCS: ref #92926
2019-03-21 16:57:28 [INFO    ] Finished processing BAM request
2019-03-21 16:57:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92926   8 58563 61048023 A  ERROR'
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 16:57:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 16:57:28 [DEBUG   ] spawn_process: at 2019-03-21 16:57:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 16:57:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:57:40 [DEBUG   ] Got command RPT from MCS: ref #92927
2019-03-21 16:57:40 [DEBUG   ] summary = ERROR
2019-03-21 16:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92927  13 58563 61060803 A  ERRORERROR'
2019-03-21 16:57:40 [DEBUG   ] Got command RPT from MCS: ref #92928
2019-03-21 16:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 16:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92928  77 58563 61060803 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 16:57:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-03-21 16:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:58:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 16:58:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:58:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:58:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:58:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:58:05 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-03-21 16:58:08 [DEBUG   ] Got command BAM from MCS: ref #92944
2019-03-21 16:58:08 [INFO    ] Finished processing BAM request
2019-03-21 16:58:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92944   8 58563 61088027 A  ERROR'
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:58:08 [DEBUG   ] spawn_process: at 2019-03-21 16:58:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:58:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 16:58:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 16:58:33 [DEBUG   ] Got command BAM from MCS: ref #92945
2019-03-21 16:58:33 [INFO    ] Finished processing BAM request
2019-03-21 16:58:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92945   8 58563 61113031 A  ERROR'
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 16:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 16:58:33 [DEBUG   ] spawn_process: at 2019-03-21 16:58:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 16:58:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 16:59:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 16:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 16:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 16:59:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 16:59:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:59:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:59:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:59:05 [WARNING ] (13, 1, 'bot')
2019-03-21 16:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 16:59:05 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-03-21 16:59:09 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:59:14 [DEBUG   ] Got command BAM from MCS: ref #92946
2019-03-21 16:59:14 [INFO    ] Finished processing BAM request
2019-03-21 16:59:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:59:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92946   8 58563 61154031 A  ERROR'
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:59:14 [DEBUG   ] spawn_process: at 2019-03-21 16:59:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:59:29 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 16:59:38 [DEBUG   ] Got command BAM from MCS: ref #92947
2019-03-21 16:59:38 [INFO    ] Finished processing BAM request
2019-03-21 16:59:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 16:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92947   8 58563 61178031 A  ERROR'
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 16:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 16:59:38 [DEBUG   ] spawn_process: at 2019-03-21 16:59:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 16:59:49 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:00:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:00:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:00:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:00:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:00:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:00:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:00:05 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-03-21 17:00:09 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 17:00:19 [DEBUG   ] Got command BAM from MCS: ref #92954
2019-03-21 17:00:19 [INFO    ] Finished processing BAM request
2019-03-21 17:00:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92954   8 58563 61219027 A  ERROR'
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:00:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:00:19 [DEBUG   ] spawn_process: at 2019-03-21 17:00:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:00:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:00:43 [DEBUG   ] Got command BAM from MCS: ref #92955
2019-03-21 17:00:43 [INFO    ] Finished processing BAM request
2019-03-21 17:00:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:00:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92955   8 58563 61243023 A  ERROR'
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:00:43 [DEBUG   ] spawn_process: at 2019-03-21 17:00:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:00:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:01:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:01:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:01:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:01:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:01:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:01:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:01:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:01:05 [DEBUG   ] Finished updating board flags in 0.986 seconds
2019-03-21 17:01:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:01:23 [DEBUG   ] Got command BAM from MCS: ref #92956
2019-03-21 17:01:23 [INFO    ] Finished processing BAM request
2019-03-21 17:01:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:01:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92956   8 58563 61283027 A  ERROR'
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:01:23 [DEBUG   ] spawn_process: at 2019-03-21 17:01:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:01:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:01:42 [DEBUG   ] Got command RPT from MCS: ref #92957
2019-03-21 17:01:42 [DEBUG   ] summary = ERROR
2019-03-21 17:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92957  13 58563 61302191 A  ERRORERROR'
2019-03-21 17:01:42 [DEBUG   ] Got command RPT from MCS: ref #92958
2019-03-21 17:01:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92958  77 58563 61302395 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:01:42 [DEBUG   ] Got command RPT from MCS: ref #92959
2019-03-21 17:01:42 [DEBUG   ] summary = ERROR
2019-03-21 17:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92959  13 58563 61302599 A  ERRORERROR'
2019-03-21 17:01:42 [DEBUG   ] Got command RPT from MCS: ref #92960
2019-03-21 17:01:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92960  77 58563 61302803 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:01:42 [DEBUG   ] Got command RPT from MCS: ref #92961
2019-03-21 17:01:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92961  12 58563 61302995 A  ERRORB ff'
2019-03-21 17:01:48 [DEBUG   ] Got command BAM from MCS: ref #92962
2019-03-21 17:01:48 [INFO    ] Finished processing BAM request
2019-03-21 17:01:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92962   8 58563 61308027 A  ERROR'
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:01:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:01:48 [DEBUG   ] spawn_process: at 2019-03-21 17:01:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:01:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:02:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:02:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:02:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:02:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:02:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:02:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:02:05 [DEBUG   ] Finished updating board flags in 1.263 seconds
2019-03-21 17:02:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:02:27 [DEBUG   ] Got command BAM from MCS: ref #92963
2019-03-21 17:02:27 [INFO    ] Finished processing BAM request
2019-03-21 17:02:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92963   8 58563 61347031 A  ERROR'
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:02:27 [DEBUG   ] spawn_process: at 2019-03-21 17:02:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:02:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:02:40 [DEBUG   ] Got command RPT from MCS: ref #92964
2019-03-21 17:02:40 [DEBUG   ] summary = ERROR
2019-03-21 17:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92964  13 58563 61360795 A  ERRORERROR'
2019-03-21 17:02:40 [DEBUG   ] Got command RPT from MCS: ref #92965
2019-03-21 17:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    92965  77 58563 61360795 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:02:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:02:52 [DEBUG   ] Got command BAM from MCS: ref #92987
2019-03-21 17:02:52 [INFO    ] Finished processing BAM request
2019-03-21 17:02:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:02:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92987   8 58563 61372023 A  ERROR'
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:02:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:02:52 [DEBUG   ] spawn_process: at 2019-03-21 17:02:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:03:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:03:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:03:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:03:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:03:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:03:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:03:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:03:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:03:05 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-03-21 17:03:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:03:30 [DEBUG   ] Got command BAM from MCS: ref #92988
2019-03-21 17:03:30 [INFO    ] Finished processing BAM request
2019-03-21 17:03:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92988   8 58563 61410023 A  ERROR'
2019-03-21 17:03:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:03:30 [DEBUG   ] spawn_process: at 2019-03-21 17:03:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:03:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:03:56 [DEBUG   ] Got command BAM from MCS: ref #92989
2019-03-21 17:03:56 [INFO    ] Finished processing BAM request
2019-03-21 17:03:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:03:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92989   8 58563 61436031 A  ERROR'
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:03:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:03:56 [DEBUG   ] spawn_process: at 2019-03-21 17:03:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:04:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-03-21 17:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:04:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:04:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:04:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:04:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:04:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:04:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:04:05 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-03-21 17:04:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:04:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:04:33 [DEBUG   ] Got command BAM from MCS: ref #92990
2019-03-21 17:04:33 [INFO    ] Finished processing BAM request
2019-03-21 17:04:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92990   8 58563 61473027 A  ERROR'
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:04:33 [DEBUG   ] spawn_process: at 2019-03-21 17:04:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:04:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:05:00 [DEBUG   ] Got command BAM from MCS: ref #92991
2019-03-21 17:05:00 [INFO    ] Finished processing BAM request
2019-03-21 17:05:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92991   8 58563 61500023 A  ERROR'
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:05:00 [DEBUG   ] spawn_process: at 2019-03-21 17:05:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:05:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:05:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:05:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:05:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:05:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:05:05 [WARNING ] (13, 1, 'bot')
2019-03-21 17:05:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:05:05 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-03-21 17:05:10 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 17:05:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:05:35 [DEBUG   ] Got command BAM from MCS: ref #92992
2019-03-21 17:05:35 [INFO    ] Finished processing BAM request
2019-03-21 17:05:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:05:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92992   8 58563 61535031 A  ERROR'
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:05:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:05:35 [DEBUG   ] spawn_process: at 2019-03-21 17:05:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:05:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:06:04 [DEBUG   ] Got command BAM from MCS: ref #92999
2019-03-21 17:06:04 [INFO    ] Finished processing BAM request
2019-03-21 17:06:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:06:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    92999   8 58563 61564031 A  ERROR'
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:06:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:06:04 [DEBUG   ] spawn_process: at 2019-03-21 17:06:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:06:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:06:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:06:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:06:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:06:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:06:06 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-03-21 17:06:10 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2019-03-21 17:06:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:06:36 [DEBUG   ] Got command BAM from MCS: ref #93000
2019-03-21 17:06:36 [INFO    ] Finished processing BAM request
2019-03-21 17:06:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93000   8 58563 61596031 A  ERROR'
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:06:36 [DEBUG   ] spawn_process: at 2019-03-21 17:06:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:06:42 [DEBUG   ] Got command RPT from MCS: ref #93003
2019-03-21 17:06:42 [DEBUG   ] summary = ERROR
2019-03-21 17:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93003  13 58563 61602283 A  ERRORERROR'
2019-03-21 17:06:42 [DEBUG   ] Got command RPT from MCS: ref #93004
2019-03-21 17:06:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93004  77 58563 61602487 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:06:42 [DEBUG   ] Got command RPT from MCS: ref #93005
2019-03-21 17:06:42 [DEBUG   ] summary = ERROR
2019-03-21 17:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93005  13 58563 61602679 A  ERRORERROR'
2019-03-21 17:06:42 [DEBUG   ] Got command RPT from MCS: ref #93007
2019-03-21 17:06:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93007  77 58563 61602883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:06:43 [DEBUG   ] Got command RPT from MCS: ref #93008
2019-03-21 17:06:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93008  12 58563 61603087 A  ERRORB¡ff'
2019-03-21 17:06:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:07:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:07:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:07:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:07:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:07:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:07:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:07:06 [DEBUG   ] Finished updating board flags in 1.290 seconds
2019-03-21 17:07:08 [DEBUG   ] Got command BAM from MCS: ref #93013
2019-03-21 17:07:08 [INFO    ] Finished processing BAM request
2019-03-21 17:07:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93013   8 58563 61628023 A  ERROR'
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:07:08 [DEBUG   ] spawn_process: at 2019-03-21 17:07:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:07:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:07:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:07:37 [DEBUG   ] Got command BAM from MCS: ref #93014
2019-03-21 17:07:37 [INFO    ] Finished processing BAM request
2019-03-21 17:07:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93014   8 58563 61657031 A  ERROR'
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:07:37 [DEBUG   ] spawn_process: at 2019-03-21 17:07:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:07:40 [DEBUG   ] Got command RPT from MCS: ref #93015
2019-03-21 17:07:40 [DEBUG   ] summary = ERROR
2019-03-21 17:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93015  13 58563 61660803 A  ERRORERROR'
2019-03-21 17:07:40 [DEBUG   ] Got command RPT from MCS: ref #93016
2019-03-21 17:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93016  77 58563 61660803 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:07:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:08:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:08:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:08:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:08:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:08:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:08:06 [DEBUG   ] Finished updating board flags in 1.108 seconds
2019-03-21 17:08:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:08:12 [DEBUG   ] Got command BAM from MCS: ref #93032
2019-03-21 17:08:12 [INFO    ] Finished processing BAM request
2019-03-21 17:08:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:08:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93032   8 58563 61692031 A  ERROR'
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:08:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:08:12 [DEBUG   ] spawn_process: at 2019-03-21 17:08:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:08:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:08:37 [DEBUG   ] Got command BAM from MCS: ref #93033
2019-03-21 17:08:37 [INFO    ] Finished processing BAM request
2019-03-21 17:08:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93033   8 58563 61717027 A  ERROR'
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:08:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:08:37 [DEBUG   ] spawn_process: at 2019-03-21 17:08:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:08:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:09:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:09:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:09:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:09:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:09:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:09:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:09:06 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-03-21 17:09:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 17:09:16 [DEBUG   ] Got command BAM from MCS: ref #93040
2019-03-21 17:09:16 [INFO    ] Finished processing BAM request
2019-03-21 17:09:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93040   8 58563 61756031 A  ERROR'
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:09:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:09:16 [DEBUG   ] spawn_process: at 2019-03-21 17:09:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:09:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:09:37 [DEBUG   ] Got command BAM from MCS: ref #93041
2019-03-21 17:09:37 [INFO    ] Finished processing BAM request
2019-03-21 17:09:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:09:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93041   8 58563 61777031 A  ERROR'
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:09:38 [DEBUG   ] spawn_process: at 2019-03-21 17:09:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:09:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2019-03-21 17:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:10:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:10:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:10:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:10:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:10:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:10:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:10:06 [DEBUG   ] Finished updating board flags in 0.996 seconds
2019-03-21 17:10:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:10:20 [DEBUG   ] Got command BAM from MCS: ref #93042
2019-03-21 17:10:20 [INFO    ] Finished processing BAM request
2019-03-21 17:10:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93042   8 58563 61820023 A  ERROR'
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:10:20 [DEBUG   ] spawn_process: at 2019-03-21 17:10:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:10:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 17:10:36 [DEBUG   ] Got command BAM from MCS: ref #93043
2019-03-21 17:10:36 [INFO    ] Finished processing BAM request
2019-03-21 17:10:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:10:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93043   8 58563 61836023 A  ERROR'
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:10:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:10:36 [DEBUG   ] spawn_process: at 2019-03-21 17:10:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:10:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-03-21 17:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:11:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:11:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:11:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:11:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:11:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:11:07 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-03-21 17:11:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:11:24 [DEBUG   ] Got command BAM from MCS: ref #93044
2019-03-21 17:11:24 [INFO    ] Finished processing BAM request
2019-03-21 17:11:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93044   8 58563 61884023 A  ERROR'
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:11:24 [DEBUG   ] spawn_process: at 2019-03-21 17:11:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:11:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 17:11:35 [DEBUG   ] Got command BAM from MCS: ref #93045
2019-03-21 17:11:35 [INFO    ] Finished processing BAM request
2019-03-21 17:11:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93045   8 58563 61895027 A  ERROR'
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:11:35 [DEBUG   ] spawn_process: at 2019-03-21 17:11:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:11:42 [DEBUG   ] Got command RPT from MCS: ref #93046
2019-03-21 17:11:42 [DEBUG   ] summary = ERROR
2019-03-21 17:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93046  13 58563 61902375 A  ERRORERROR'
2019-03-21 17:11:42 [DEBUG   ] Got command RPT from MCS: ref #93047
2019-03-21 17:11:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93047  77 58563 61902567 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:11:42 [DEBUG   ] Got command RPT from MCS: ref #93048
2019-03-21 17:11:42 [DEBUG   ] summary = ERROR
2019-03-21 17:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93048  13 58563 61902771 A  ERRORERROR'
2019-03-21 17:11:42 [DEBUG   ] Got command RPT from MCS: ref #93049
2019-03-21 17:11:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93049  77 58563 61902975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:11:43 [DEBUG   ] Got command RPT from MCS: ref #93050
2019-03-21 17:11:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93050  12 58563 61903167 A  ERRORB¡ff'
2019-03-21 17:11:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:12:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:12:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:12:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:12:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:12:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:12:06 [DEBUG   ] Finished updating board flags in 1.239 seconds
2019-03-21 17:12:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 17:12:28 [DEBUG   ] Got command BAM from MCS: ref #93057
2019-03-21 17:12:28 [INFO    ] Finished processing BAM request
2019-03-21 17:12:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93057   8 58563 61948027 A  ERROR'
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:12:28 [DEBUG   ] spawn_process: at 2019-03-21 17:12:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:12:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:12:33 [DEBUG   ] Got command BAM from MCS: ref #93058
2019-03-21 17:12:33 [INFO    ] Finished processing BAM request
2019-03-21 17:12:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93058   8 58563 61953023 A  ERROR'
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:12:33 [DEBUG   ] spawn_process: at 2019-03-21 17:12:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:12:40 [DEBUG   ] Got command RPT from MCS: ref #93059
2019-03-21 17:12:40 [DEBUG   ] summary = ERROR
2019-03-21 17:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93059  13 58563 61960799 A  ERRORERROR'
2019-03-21 17:12:40 [DEBUG   ] Got command RPT from MCS: ref #93060
2019-03-21 17:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93060  77 58563 61960799 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:12:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:13:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:13:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:13:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:13:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:13:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:13:06 [DEBUG   ] Finished updating board flags in 1.230 seconds
2019-03-21 17:13:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:13:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:13:31 [DEBUG   ] Got command BAM from MCS: ref #93076
2019-03-21 17:13:31 [INFO    ] Finished processing BAM request
2019-03-21 17:13:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93076   8 58563 62011027 A  ERROR'
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:13:31 [DEBUG   ] spawn_process: at 2019-03-21 17:13:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:13:32 [DEBUG   ] Got command BAM from MCS: ref #93077
2019-03-21 17:13:32 [INFO    ] Finished processing BAM request
2019-03-21 17:13:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93077   8 58563 62012031 A  ERROR'
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:13:32 [DEBUG   ] spawn_process: at 2019-03-21 17:13:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:13:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:14:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 17:14:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:14:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:14:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:14:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:14:06 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-03-21 17:14:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:14:28 [DEBUG   ] Got command BAM from MCS: ref #93078
2019-03-21 17:14:28 [INFO    ] Finished processing BAM request
2019-03-21 17:14:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93078   8 58563 62068031 A  ERROR'
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:14:28 [DEBUG   ] spawn_process: at 2019-03-21 17:14:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:14:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:14:36 [DEBUG   ] Got command BAM from MCS: ref #93079
2019-03-21 17:14:36 [INFO    ] Finished processing BAM request
2019-03-21 17:14:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:14:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93079   8 58563 62076023 A  ERROR'
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:14:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:14:36 [DEBUG   ] spawn_process: at 2019-03-21 17:14:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:14:50 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 17:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-03-21 17:15:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:15:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:15:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:15:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:15:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:15:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:15:06 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-03-21 17:15:10 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-21 17:15:25 [DEBUG   ] Got command BAM from MCS: ref #93086
2019-03-21 17:15:25 [INFO    ] Finished processing BAM request
2019-03-21 17:15:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93086   8 58563 62125031 A  ERROR'
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:15:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:15:25 [DEBUG   ] spawn_process: at 2019-03-21 17:15:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:15:30 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:15:40 [DEBUG   ] Got command BAM from MCS: ref #93087
2019-03-21 17:15:40 [INFO    ] Finished processing BAM request
2019-03-21 17:15:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93087   8 58563 62140023 A  ERROR'
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:15:40 [DEBUG   ] spawn_process: at 2019-03-21 17:15:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:15:50 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:16:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:16:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:16:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:16:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:16:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:16:06 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-03-21 17:16:10 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 17:16:22 [DEBUG   ] Got command BAM from MCS: ref #93088
2019-03-21 17:16:22 [INFO    ] Finished processing BAM request
2019-03-21 17:16:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93088   8 58563 62182031 A  ERROR'
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:16:22 [DEBUG   ] spawn_process: at 2019-03-21 17:16:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:16:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:16:42 [DEBUG   ] Got command RPT from MCS: ref #93091
2019-03-21 17:16:42 [DEBUG   ] summary = ERROR
2019-03-21 17:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93091  13 58563 62202451 A  ERRORERROR'
2019-03-21 17:16:42 [DEBUG   ] Got command RPT from MCS: ref #93092
2019-03-21 17:16:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93092  77 58563 62202655 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:16:42 [DEBUG   ] Got command RPT from MCS: ref #93093
2019-03-21 17:16:42 [DEBUG   ] summary = ERROR
2019-03-21 17:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93093  13 58563 62202859 A  ERRORERROR'
2019-03-21 17:16:43 [DEBUG   ] Got command RPT from MCS: ref #93096
2019-03-21 17:16:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93096  77 58563 62203051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:16:43 [DEBUG   ] Got command RPT from MCS: ref #93098
2019-03-21 17:16:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93098  12 58563 62203255 A  ERRORB¡ff'
2019-03-21 17:16:44 [DEBUG   ] Got command BAM from MCS: ref #93094
2019-03-21 17:16:44 [INFO    ] Finished processing BAM request
2019-03-21 17:16:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93094   8 58563 62204027 A  ERROR'
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:16:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:16:44 [DEBUG   ] spawn_process: at 2019-03-21 17:16:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:16:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:17:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:17:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:17:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:17:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:17:06 [WARNING ] (13, 1, 'bot')
2019-03-21 17:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:17:06 [DEBUG   ] Finished updating board flags in 0.978 seconds
2019-03-21 17:17:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:17:18 [DEBUG   ] Got command BAM from MCS: ref #93102
2019-03-21 17:17:18 [INFO    ] Finished processing BAM request
2019-03-21 17:17:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93102   8 58563 62238031 A  ERROR'
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:17:18 [DEBUG   ] spawn_process: at 2019-03-21 17:17:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:17:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:17:40 [DEBUG   ] Got command RPT from MCS: ref #93103
2019-03-21 17:17:40 [DEBUG   ] summary = ERROR
2019-03-21 17:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93103  13 58563 62260807 A  ERRORERROR'
2019-03-21 17:17:40 [DEBUG   ] Got command RPT from MCS: ref #93104
2019-03-21 17:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93104  77 58563 62260807 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:17:48 [DEBUG   ] Got command BAM from MCS: ref #93126
2019-03-21 17:17:48 [INFO    ] Finished processing BAM request
2019-03-21 17:17:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:17:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93126   8 58563 62268023 A  ERROR'
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:17:48 [DEBUG   ] spawn_process: at 2019-03-21 17:17:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:17:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-03-21 17:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:18:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:18:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:18:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:18:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:18:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:18:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:18:07 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-03-21 17:18:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:18:14 [DEBUG   ] Got command BAM from MCS: ref #93127
2019-03-21 17:18:14 [INFO    ] Finished processing BAM request
2019-03-21 17:18:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93127   8 58563 62294027 A  ERROR'
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:18:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:18:14 [DEBUG   ] spawn_process: at 2019-03-21 17:18:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:18:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:18:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:18:52 [DEBUG   ] Got command BAM from MCS: ref #93128
2019-03-21 17:18:52 [INFO    ] Finished processing BAM request
2019-03-21 17:18:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:18:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93128   8 58563 62332023 A  ERROR'
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:18:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:18:52 [DEBUG   ] spawn_process: at 2019-03-21 17:18:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:19:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:19:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 17:19:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:19:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:19:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:19:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:19:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:19:07 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-03-21 17:19:09 [DEBUG   ] Got command BAM from MCS: ref #93129
2019-03-21 17:19:09 [INFO    ] Finished processing BAM request
2019-03-21 17:19:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:19:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93129   8 58563 62349027 A  ERROR'
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:19:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:19:09 [DEBUG   ] spawn_process: at 2019-03-21 17:19:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:19:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:19:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:19:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:19:56 [DEBUG   ] Got command BAM from MCS: ref #93130
2019-03-21 17:19:56 [INFO    ] Finished processing BAM request
2019-03-21 17:19:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93130   8 58563 62396027 A  ERROR'
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:19:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:19:56 [DEBUG   ] spawn_process: at 2019-03-21 17:19:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:20:04 [DEBUG   ] Got command BAM from MCS: ref #93131
2019-03-21 17:20:04 [INFO    ] Finished processing BAM request
2019-03-21 17:20:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93131   8 58563 62404027 A  ERROR'
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:20:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:20:04 [DEBUG   ] spawn_process: at 2019-03-21 17:20:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-03-21 17:20:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:20:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:20:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:20:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:20:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:20:07 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-03-21 17:20:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:20:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:20:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:20:59 [DEBUG   ] Got command BAM from MCS: ref #93138
2019-03-21 17:20:59 [INFO    ] Finished processing BAM request
2019-03-21 17:20:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93138   8 58563 62459023 A  ERROR'
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:20:59 [DEBUG   ] spawn_process: at 2019-03-21 17:20:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:21:00 [DEBUG   ] Got command BAM from MCS: ref #93139
2019-03-21 17:21:00 [INFO    ] Finished processing BAM request
2019-03-21 17:21:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93139   8 58563 62460023 A  ERROR'
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:21:00 [DEBUG   ] spawn_process: at 2019-03-21 17:21:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:21:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:21:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:21:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:21:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:21:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:21:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:21:07 [DEBUG   ] Finished updating board flags in 1.158 seconds
2019-03-21 17:21:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:21:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:21:42 [DEBUG   ] Got command RPT from MCS: ref #93140
2019-03-21 17:21:42 [DEBUG   ] summary = ERROR
2019-03-21 17:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93140  13 58563 62502543 A  ERRORERROR'
2019-03-21 17:21:42 [DEBUG   ] Got command RPT from MCS: ref #93141
2019-03-21 17:21:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93141  77 58563 62502747 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:21:42 [DEBUG   ] Got command RPT from MCS: ref #93142
2019-03-21 17:21:42 [DEBUG   ] summary = ERROR
2019-03-21 17:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93142  13 58563 62502939 A  ERRORERROR'
2019-03-21 17:21:43 [DEBUG   ] Got command RPT from MCS: ref #93143
2019-03-21 17:21:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93143  77 58563 62503143 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:21:43 [DEBUG   ] Got command RPT from MCS: ref #93144
2019-03-21 17:21:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93144  12 58563 62503347 A  ERRORB¡ff'
2019-03-21 17:21:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:21:53 [DEBUG   ] Got command BAM from MCS: ref #93145
2019-03-21 17:21:53 [INFO    ] Finished processing BAM request
2019-03-21 17:21:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93145   8 58563 62513023 A  ERROR'
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:21:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:21:53 [DEBUG   ] spawn_process: at 2019-03-21 17:21:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:22:04 [DEBUG   ] Got command BAM from MCS: ref #93146
2019-03-21 17:22:04 [INFO    ] Finished processing BAM request
2019-03-21 17:22:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:22:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93146   8 58563 62524031 A  ERROR'
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:22:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:22:04 [DEBUG   ] spawn_process: at 2019-03-21 17:22:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 17:22:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:22:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:22:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:22:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:22:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:22:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:22:07 [DEBUG   ] Finished updating board flags in 1.300 seconds
2019-03-21 17:22:11 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 17:22:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:22:40 [DEBUG   ] Got command RPT from MCS: ref #93147
2019-03-21 17:22:40 [DEBUG   ] summary = ERROR
2019-03-21 17:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93147  13 58563 62560811 A  ERRORERROR'
2019-03-21 17:22:40 [DEBUG   ] Got command RPT from MCS: ref #93148
2019-03-21 17:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93148  77 58563 62560811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:22:47 [DEBUG   ] Got command BAM from MCS: ref #93164
2019-03-21 17:22:47 [INFO    ] Finished processing BAM request
2019-03-21 17:22:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:22:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93164   8 58563 62567031 A  ERROR'
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:22:47 [DEBUG   ] spawn_process: at 2019-03-21 17:22:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:22:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:23:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:23:08 [DEBUG   ] Got command BAM from MCS: ref #93165
2019-03-21 17:23:08 [INFO    ] Finished processing BAM request
2019-03-21 17:23:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:23:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93165   8 58563 62588027 A  ERROR'
2019-03-21 17:23:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:23:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:23:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:23:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:23:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:23:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:23:08 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:23:08 [DEBUG   ] spawn_process: at 2019-03-21 17:23:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:23:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:23:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:23:40 [DEBUG   ] Got command BAM from MCS: ref #93166
2019-03-21 17:23:40 [INFO    ] Finished processing BAM request
2019-03-21 17:23:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93166   8 58563 62620023 A  ERROR'
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:23:40 [DEBUG   ] spawn_process: at 2019-03-21 17:23:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:23:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:24:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:24:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:24:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:24:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:24:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:24:07 [DEBUG   ] Finished updating board flags in 1.172 seconds
2019-03-21 17:24:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:24:12 [DEBUG   ] Got command BAM from MCS: ref #93173
2019-03-21 17:24:12 [INFO    ] Finished processing BAM request
2019-03-21 17:24:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93173   8 58563 62652027 A  ERROR'
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:24:12 [DEBUG   ] spawn_process: at 2019-03-21 17:24:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:24:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:24:33 [DEBUG   ] Got command BAM from MCS: ref #93174
2019-03-21 17:24:33 [INFO    ] Finished processing BAM request
2019-03-21 17:24:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:24:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93174   8 58563 62673031 A  ERROR'
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:24:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:24:33 [DEBUG   ] spawn_process: at 2019-03-21 17:24:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:24:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:25:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:25:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:25:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:25:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:25:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:25:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:25:07 [DEBUG   ] Finished updating board flags in 1.029 seconds
2019-03-21 17:25:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:25:16 [DEBUG   ] Got command BAM from MCS: ref #93175
2019-03-21 17:25:16 [INFO    ] Finished processing BAM request
2019-03-21 17:25:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93175   8 58563 62716031 A  ERROR'
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:25:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:25:16 [DEBUG   ] spawn_process: at 2019-03-21 17:25:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:25:26 [DEBUG   ] Got command BAM from MCS: ref #93176
2019-03-21 17:25:26 [INFO    ] Finished processing BAM request
2019-03-21 17:25:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93176   8 58563 62726031 A  ERROR'
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:25:26 [DEBUG   ] spawn_process: at 2019-03-21 17:25:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:25:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:25:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:26:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:26:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:26:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:26:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:26:07 [WARNING ] (13, 1, 'bot')
2019-03-21 17:26:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:26:07 [DEBUG   ] Finished updating board flags in 0.973 seconds
2019-03-21 17:26:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:26:18 [DEBUG   ] Got command BAM from MCS: ref #93177
2019-03-21 17:26:18 [INFO    ] Finished processing BAM request
2019-03-21 17:26:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:26:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93177   8 58563 62778031 A  ERROR'
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:26:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:26:18 [DEBUG   ] spawn_process: at 2019-03-21 17:26:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:26:20 [DEBUG   ] Got command BAM from MCS: ref #93178
2019-03-21 17:26:20 [INFO    ] Finished processing BAM request
2019-03-21 17:26:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93178   8 58563 62780027 A  ERROR'
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:26:20 [DEBUG   ] spawn_process: at 2019-03-21 17:26:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:26:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:26:42 [DEBUG   ] Got command RPT from MCS: ref #93181
2019-03-21 17:26:42 [DEBUG   ] summary = ERROR
2019-03-21 17:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93181  13 58563 62802623 A  ERRORERROR'
2019-03-21 17:26:42 [DEBUG   ] Got command RPT from MCS: ref #93182
2019-03-21 17:26:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93182  77 58563 62802827 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:26:43 [DEBUG   ] Got command RPT from MCS: ref #93183
2019-03-21 17:26:43 [DEBUG   ] summary = ERROR
2019-03-21 17:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93183  13 58563 62803031 A  ERRORERROR'
2019-03-21 17:26:43 [DEBUG   ] Got command RPT from MCS: ref #93185
2019-03-21 17:26:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93185  77 58563 62803223 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:26:43 [DEBUG   ] Got command RPT from MCS: ref #93187
2019-03-21 17:26:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93187  12 58563 62803427 A  ERRORB¡ff'
2019-03-21 17:26:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:27:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:27:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:27:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:27:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:27:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:27:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:27:08 [DEBUG   ] Finished updating board flags in 1.361 seconds
2019-03-21 17:27:10 [DEBUG   ] Got command BAM from MCS: ref #93197
2019-03-21 17:27:10 [INFO    ] Finished processing BAM request
2019-03-21 17:27:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:27:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93197   8 58563 62830023 A  ERROR'
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:27:10 [DEBUG   ] spawn_process: at 2019-03-21 17:27:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:27:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:27:24 [DEBUG   ] Got command BAM from MCS: ref #93198
2019-03-21 17:27:24 [INFO    ] Finished processing BAM request
2019-03-21 17:27:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93198   8 58563 62844031 A  ERROR'
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:27:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:27:24 [DEBUG   ] spawn_process: at 2019-03-21 17:27:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:27:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:27:40 [DEBUG   ] Got command RPT from MCS: ref #93199
2019-03-21 17:27:40 [DEBUG   ] summary = ERROR
2019-03-21 17:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93199  13 58563 62860807 A  ERRORERROR'
2019-03-21 17:27:40 [DEBUG   ] Got command RPT from MCS: ref #93200
2019-03-21 17:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93200  77 58563 62860807 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:27:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:28:02 [DEBUG   ] Got command BAM from MCS: ref #93216
2019-03-21 17:28:02 [INFO    ] Finished processing BAM request
2019-03-21 17:28:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:28:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93216   8 58563 62882027 A  ERROR'
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:28:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:28:02 [DEBUG   ] spawn_process: at 2019-03-21 17:28:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:28:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:28:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:28:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:28:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:28:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:28:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:28:08 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-03-21 17:28:11 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 17:28:28 [DEBUG   ] Got command BAM from MCS: ref #93217
2019-03-21 17:28:28 [INFO    ] Finished processing BAM request
2019-03-21 17:28:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93217   8 58563 62908023 A  ERROR'
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:28:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:28:28 [DEBUG   ] spawn_process: at 2019-03-21 17:28:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:28:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 17:28:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 17:28:53 [DEBUG   ] Got command BAM from MCS: ref #93218
2019-03-21 17:28:53 [INFO    ] Finished processing BAM request
2019-03-21 17:28:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93218   8 58563 62933023 A  ERROR'
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:28:53 [DEBUG   ] spawn_process: at 2019-03-21 17:28:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:29:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:29:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:29:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:29:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:29:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:29:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:29:08 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-03-21 17:29:11 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-21 17:29:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:29:32 [DEBUG   ] Got command BAM from MCS: ref #93219
2019-03-21 17:29:32 [INFO    ] Finished processing BAM request
2019-03-21 17:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93219   8 58563 62972027 A  ERROR'
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:29:32 [DEBUG   ] spawn_process: at 2019-03-21 17:29:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:29:44 [DEBUG   ] Got command BAM from MCS: ref #93220
2019-03-21 17:29:44 [INFO    ] Finished processing BAM request
2019-03-21 17:29:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:29:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93220   8 58563 62984031 A  ERROR'
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:29:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:29:44 [DEBUG   ] spawn_process: at 2019-03-21 17:29:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:29:51 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:30:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:30:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:30:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:30:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:30:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:30:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:30:08 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-03-21 17:30:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 17:30:31 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 17:30:35 [DEBUG   ] Got command BAM from MCS: ref #93227
2019-03-21 17:30:35 [INFO    ] Finished processing BAM request
2019-03-21 17:30:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:30:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93227   8 58563 63035031 A  ERROR'
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:30:35 [DEBUG   ] spawn_process: at 2019-03-21 17:30:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:30:36 [DEBUG   ] Got command BAM from MCS: ref #93228
2019-03-21 17:30:36 [INFO    ] Finished processing BAM request
2019-03-21 17:30:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93228   8 58563 63036027 A  ERROR'
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:30:36 [DEBUG   ] spawn_process: at 2019-03-21 17:30:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:30:52 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-21 17:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 17:31:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:31:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:31:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:31:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:31:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:31:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:31:08 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-03-21 17:31:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:31:26 [DEBUG   ] Got command BAM from MCS: ref #93229
2019-03-21 17:31:26 [INFO    ] Finished processing BAM request
2019-03-21 17:31:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93229   8 58563 63086031 A  ERROR'
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:31:26 [DEBUG   ] spawn_process: at 2019-03-21 17:31:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:31:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:31:40 [DEBUG   ] Got command BAM from MCS: ref #93230
2019-03-21 17:31:40 [INFO    ] Finished processing BAM request
2019-03-21 17:31:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93230   8 58563 63100031 A  ERROR'
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:31:40 [DEBUG   ] spawn_process: at 2019-03-21 17:31:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:31:42 [DEBUG   ] Got command RPT from MCS: ref #93231
2019-03-21 17:31:42 [DEBUG   ] summary = ERROR
2019-03-21 17:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93231  13 58563 63102707 A  ERRORERROR'
2019-03-21 17:31:42 [DEBUG   ] Got command RPT from MCS: ref #93232
2019-03-21 17:31:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93232  77 58563 63102911 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:31:43 [DEBUG   ] Got command RPT from MCS: ref #93233
2019-03-21 17:31:43 [DEBUG   ] summary = ERROR
2019-03-21 17:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93233  13 58563 63103115 A  ERRORERROR'
2019-03-21 17:31:43 [DEBUG   ] Got command RPT from MCS: ref #93234
2019-03-21 17:31:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93234  77 58563 63103319 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:31:43 [DEBUG   ] Got command RPT from MCS: ref #93235
2019-03-21 17:31:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93235  12 58563 63103511 A  ERRORB ff'
2019-03-21 17:31:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-03-21 17:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:32:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:32:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:32:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:32:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:32:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:32:08 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-03-21 17:32:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:32:16 [DEBUG   ] Got command BAM from MCS: ref #93236
2019-03-21 17:32:16 [INFO    ] Finished processing BAM request
2019-03-21 17:32:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:32:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93236   8 58563 63136031 A  ERROR'
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:32:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:32:16 [DEBUG   ] spawn_process: at 2019-03-21 17:32:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:32:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:32:40 [DEBUG   ] Got command RPT from MCS: ref #93237
2019-03-21 17:32:40 [DEBUG   ] summary = ERROR
2019-03-21 17:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93237  13 58563 63160811 A  ERRORERROR'
2019-03-21 17:32:40 [DEBUG   ] Got command RPT from MCS: ref #93238
2019-03-21 17:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93238  77 58563 63160811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:32:44 [DEBUG   ] Got command BAM from MCS: ref #93254
2019-03-21 17:32:44 [INFO    ] Finished processing BAM request
2019-03-21 17:32:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:32:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93254   8 58563 63164023 A  ERROR'
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:32:44 [DEBUG   ] spawn_process: at 2019-03-21 17:32:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:32:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:33:06 [DEBUG   ] Got command BAM from MCS: ref #93261
2019-03-21 17:33:06 [INFO    ] Finished processing BAM request
2019-03-21 17:33:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93261   8 58563 63186031 A  ERROR'
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:33:06 [DEBUG   ] spawn_process: at 2019-03-21 17:33:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-03-21 17:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:33:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:33:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:33:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:33:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:33:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:33:08 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-03-21 17:33:12 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 17:33:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:33:48 [DEBUG   ] Got command BAM from MCS: ref #93262
2019-03-21 17:33:48 [INFO    ] Finished processing BAM request
2019-03-21 17:33:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:33:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93262   8 58563 63228023 A  ERROR'
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:33:48 [DEBUG   ] spawn_process: at 2019-03-21 17:33:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:33:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:33:56 [DEBUG   ] Got command BAM from MCS: ref #93263
2019-03-21 17:33:56 [INFO    ] Finished processing BAM request
2019-03-21 17:33:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93263   8 58563 63236031 A  ERROR'
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:33:56 [DEBUG   ] spawn_process: at 2019-03-21 17:33:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:34:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:34:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:34:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:34:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:34:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:34:08 [DEBUG   ] Finished updating board flags in 1.186 seconds
2019-03-21 17:34:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:34:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:34:45 [DEBUG   ] Got command BAM from MCS: ref #93264
2019-03-21 17:34:45 [INFO    ] Finished processing BAM request
2019-03-21 17:34:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:34:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93264   8 58563 63285027 A  ERROR'
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:34:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:34:45 [DEBUG   ] spawn_process: at 2019-03-21 17:34:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:34:52 [DEBUG   ] Got command BAM from MCS: ref #93265
2019-03-21 17:34:52 [INFO    ] Finished processing BAM request
2019-03-21 17:34:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93265   8 58563 63292027 A  ERROR'
2019-03-21 17:34:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:34:52 [DEBUG   ] spawn_process: at 2019-03-21 17:34:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:35:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:35:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:35:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:35:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:35:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:35:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:35:08 [DEBUG   ] Finished updating board flags in 1.025 seconds
2019-03-21 17:35:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:35:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:35:34 [DEBUG   ] Got command BAM from MCS: ref #93266
2019-03-21 17:35:34 [INFO    ] Finished processing BAM request
2019-03-21 17:35:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:35:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93266   8 58563 63334031 A  ERROR'
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:35:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:35:34 [DEBUG   ] spawn_process: at 2019-03-21 17:35:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:35:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:35:56 [DEBUG   ] Got command BAM from MCS: ref #93273
2019-03-21 17:35:56 [INFO    ] Finished processing BAM request
2019-03-21 17:35:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:35:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93273   8 58563 63356023 A  ERROR'
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:35:56 [DEBUG   ] spawn_process: at 2019-03-21 17:35:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:36:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:36:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:36:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:36:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:36:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:36:08 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-03-21 17:36:12 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 17:36:23 [DEBUG   ] Got command BAM from MCS: ref #93274
2019-03-21 17:36:23 [INFO    ] Finished processing BAM request
2019-03-21 17:36:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93274   8 58563 63383027 A  ERROR'
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:36:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:36:23 [DEBUG   ] spawn_process: at 2019-03-21 17:36:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:36:32 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 17:36:42 [DEBUG   ] Got command RPT from MCS: ref #93277
2019-03-21 17:36:42 [DEBUG   ] summary = ERROR
2019-03-21 17:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93277  13 58563 63402799 A  ERRORERROR'
2019-03-21 17:36:43 [DEBUG   ] Got command RPT from MCS: ref #93278
2019-03-21 17:36:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93278  77 58563 63403003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:36:43 [DEBUG   ] Got command RPT from MCS: ref #93279
2019-03-21 17:36:43 [DEBUG   ] summary = ERROR
2019-03-21 17:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93279  13 58563 63403195 A  ERRORERROR'
2019-03-21 17:36:43 [DEBUG   ] Got command RPT from MCS: ref #93281
2019-03-21 17:36:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93281  77 58563 63403399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:36:43 [DEBUG   ] Got command RPT from MCS: ref #93282
2019-03-21 17:36:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93282  12 58563 63403603 A  ERRORB¢ff'
2019-03-21 17:36:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:37:00 [DEBUG   ] Got command BAM from MCS: ref #93287
2019-03-21 17:37:00 [INFO    ] Finished processing BAM request
2019-03-21 17:37:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93287   8 58563 63420027 A  ERROR'
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:37:00 [DEBUG   ] spawn_process: at 2019-03-21 17:37:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 17:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:37:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:37:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:37:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:37:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:37:08 [WARNING ] (13, 1, 'bot')
2019-03-21 17:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:37:08 [DEBUG   ] Finished updating board flags in 0.990 seconds
2019-03-21 17:37:12 [DEBUG   ] Got command BAM from MCS: ref #93288
2019-03-21 17:37:12 [INFO    ] Finished processing BAM request
2019-03-21 17:37:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93288   8 58563 63432023 A  ERROR'
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:37:12 [DEBUG   ] spawn_process: at 2019-03-21 17:37:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:37:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:37:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:37:40 [DEBUG   ] Got command RPT from MCS: ref #93289
2019-03-21 17:37:40 [DEBUG   ] summary = ERROR
2019-03-21 17:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93289  13 58563 63460815 A  ERRORERROR'
2019-03-21 17:37:40 [DEBUG   ] Got command RPT from MCS: ref #93290
2019-03-21 17:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93290  77 58563 63460815 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:37:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:38:00 [DEBUG   ] Got command BAM from MCS: ref #93306
2019-03-21 17:38:00 [INFO    ] Finished processing BAM request
2019-03-21 17:38:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93306   8 58563 63480023 A  ERROR'
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:38:00 [DEBUG   ] spawn_process: at 2019-03-21 17:38:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:38:04 [DEBUG   ] Got command BAM from MCS: ref #93307
2019-03-21 17:38:04 [INFO    ] Finished processing BAM request
2019-03-21 17:38:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93307   8 58563 63484023 A  ERROR'
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:38:04 [DEBUG   ] spawn_process: at 2019-03-21 17:38:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:38:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 17:38:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:38:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:38:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:38:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:38:09 [DEBUG   ] Finished updating board flags in 1.348 seconds
2019-03-21 17:38:13 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 17:38:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:38:48 [DEBUG   ] Got command BAM from MCS: ref #93314
2019-03-21 17:38:48 [INFO    ] Finished processing BAM request
2019-03-21 17:38:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93314   8 58563 63528031 A  ERROR'
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:38:48 [DEBUG   ] spawn_process: at 2019-03-21 17:38:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:38:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 17:39:08 [DEBUG   ] Got command BAM from MCS: ref #93315
2019-03-21 17:39:08 [INFO    ] Finished processing BAM request
2019-03-21 17:39:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93315   8 58563 63548031 A  ERROR'
2019-03-21 17:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-03-21 17:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:39:08 [DEBUG   ] spawn_process: at 2019-03-21 17:39:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:39:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:39:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:39:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:39:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:39:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:39:09 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-03-21 17:39:13 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-21 17:39:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:39:36 [DEBUG   ] Got command BAM from MCS: ref #93316
2019-03-21 17:39:36 [INFO    ] Finished processing BAM request
2019-03-21 17:39:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:39:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93316   8 58563 63576023 A  ERROR'
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:39:36 [DEBUG   ] spawn_process: at 2019-03-21 17:39:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:39:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:40:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:40:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:40:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:40:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:40:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:40:09 [DEBUG   ] Finished updating board flags in 1.044 seconds
2019-03-21 17:40:12 [DEBUG   ] Got command BAM from MCS: ref #93317
2019-03-21 17:40:12 [INFO    ] Finished processing BAM request
2019-03-21 17:40:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93317   8 58563 63612031 A  ERROR'
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:40:12 [DEBUG   ] spawn_process: at 2019-03-21 17:40:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:40:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:40:24 [DEBUG   ] Got command BAM from MCS: ref #93318
2019-03-21 17:40:24 [INFO    ] Finished processing BAM request
2019-03-21 17:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93318   8 58563 63624031 A  ERROR'
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:40:24 [DEBUG   ] spawn_process: at 2019-03-21 17:40:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:40:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:40:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:41:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:41:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:41:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-03-21 17:41:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:41:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:41:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:41:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:41:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:41:10 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-03-21 17:41:11 [DEBUG   ] Got command BAM from MCS: ref #93319
2019-03-21 17:41:11 [INFO    ] Finished processing BAM request
2019-03-21 17:41:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93319   8 58563 63671027 A  ERROR'
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:41:11 [DEBUG   ] spawn_process: at 2019-03-21 17:41:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:41:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:41:16 [DEBUG   ] Got command BAM from MCS: ref #93320
2019-03-21 17:41:16 [INFO    ] Finished processing BAM request
2019-03-21 17:41:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93320   8 58563 63676023 A  ERROR'
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:41:16 [DEBUG   ] spawn_process: at 2019-03-21 17:41:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:41:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:41:42 [DEBUG   ] Got command RPT from MCS: ref #93321
2019-03-21 17:41:42 [DEBUG   ] summary = ERROR
2019-03-21 17:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93321  13 58563 63702879 A  ERRORERROR'
2019-03-21 17:41:43 [DEBUG   ] Got command RPT from MCS: ref #93322
2019-03-21 17:41:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93322  77 58563 63703083 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:41:43 [DEBUG   ] Got command RPT from MCS: ref #93323
2019-03-21 17:41:43 [DEBUG   ] summary = ERROR
2019-03-21 17:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93323  13 58563 63703287 A  ERRORERROR'
2019-03-21 17:41:43 [DEBUG   ] Got command RPT from MCS: ref #93324
2019-03-21 17:41:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93324  77 58563 63703491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:41:43 [DEBUG   ] Got command RPT from MCS: ref #93325
2019-03-21 17:41:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93325  12 58563 63703683 A  ERRORB¡ff'
2019-03-21 17:41:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:41:58 [DEBUG   ] Got command BAM from MCS: ref #93332
2019-03-21 17:41:58 [INFO    ] Finished processing BAM request
2019-03-21 17:41:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93332   8 58563 63718027 A  ERROR'
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:41:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:41:58 [DEBUG   ] spawn_process: at 2019-03-21 17:41:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 17:42:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:42:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:42:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:42:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:42:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:42:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:42:09 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-03-21 17:42:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:42:20 [DEBUG   ] Got command BAM from MCS: ref #93333
2019-03-21 17:42:20 [INFO    ] Finished processing BAM request
2019-03-21 17:42:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93333   8 58563 63740027 A  ERROR'
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:42:20 [DEBUG   ] spawn_process: at 2019-03-21 17:42:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:42:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:42:40 [DEBUG   ] Got command RPT from MCS: ref #93334
2019-03-21 17:42:40 [DEBUG   ] summary = ERROR
2019-03-21 17:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93334  13 58563 63760811 A  ERRORERROR'
2019-03-21 17:42:40 [DEBUG   ] Got command RPT from MCS: ref #93335
2019-03-21 17:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93335  77 58563 63760811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:42:45 [DEBUG   ] Got command BAM from MCS: ref #93351
2019-03-21 17:42:45 [INFO    ] Finished processing BAM request
2019-03-21 17:42:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:42:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93351   8 58563 63765027 A  ERROR'
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:42:45 [DEBUG   ] spawn_process: at 2019-03-21 17:42:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:42:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:43:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:43:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:43:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:43:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:43:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:43:09 [DEBUG   ] Finished updating board flags in 1.250 seconds
2019-03-21 17:43:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:43:24 [DEBUG   ] Got command BAM from MCS: ref #93352
2019-03-21 17:43:24 [INFO    ] Finished processing BAM request
2019-03-21 17:43:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93352   8 58563 63804023 A  ERROR'
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:43:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:43:24 [DEBUG   ] spawn_process: at 2019-03-21 17:43:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:43:32 [DEBUG   ] Got command BAM from MCS: ref #93353
2019-03-21 17:43:32 [INFO    ] Finished processing BAM request
2019-03-21 17:43:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93353   8 58563 63812031 A  ERROR'
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:43:32 [DEBUG   ] spawn_process: at 2019-03-21 17:43:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:43:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:43:54 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 17:44:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:44:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:44:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-03-21 17:44:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:44:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:44:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:44:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:44:09 [DEBUG   ] Finished updating board flags in 1.163 seconds
2019-03-21 17:44:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:44:19 [DEBUG   ] Got command BAM from MCS: ref #93354
2019-03-21 17:44:19 [INFO    ] Finished processing BAM request
2019-03-21 17:44:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:44:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93354   8 58563 63859027 A  ERROR'
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:44:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:44:19 [DEBUG   ] spawn_process: at 2019-03-21 17:44:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:44:28 [DEBUG   ] Got command BAM from MCS: ref #93355
2019-03-21 17:44:28 [INFO    ] Finished processing BAM request
2019-03-21 17:44:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:44:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93355   8 58563 63868031 A  ERROR'
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:44:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:44:28 [DEBUG   ] spawn_process: at 2019-03-21 17:44:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:44:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:44:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:45:05 [DEBUG   ] Got command BAM from MCS: ref #93362
2019-03-21 17:45:05 [INFO    ] Finished processing BAM request
2019-03-21 17:45:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93362   8 58563 63905031 A  ERROR'
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:45:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:45:05 [DEBUG   ] spawn_process: at 2019-03-21 17:45:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:45:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:45:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:45:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:45:09 [WARNING ] (13, 1, 'bot')
2019-03-21 17:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:45:09 [DEBUG   ] Finished updating board flags in 1.000 seconds
2019-03-21 17:45:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 17:45:32 [DEBUG   ] Got command BAM from MCS: ref #93363
2019-03-21 17:45:32 [INFO    ] Finished processing BAM request
2019-03-21 17:45:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:45:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93363   8 58563 63932031 A  ERROR'
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:45:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:45:32 [DEBUG   ] spawn_process: at 2019-03-21 17:45:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:45:34 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 17:45:51 [DEBUG   ] Got command BAM from MCS: ref #93364
2019-03-21 17:45:51 [INFO    ] Finished processing BAM request
2019-03-21 17:45:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:45:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93364   8 58563 63951031 A  ERROR'
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:45:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:45:51 [DEBUG   ] spawn_process: at 2019-03-21 17:45:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:45:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:46:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:46:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:46:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:46:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:46:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:46:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:46:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:46:10 [DEBUG   ] Finished updating board flags in 1.361 seconds
2019-03-21 17:46:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:46:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:46:36 [DEBUG   ] Got command BAM from MCS: ref #93365
2019-03-21 17:46:36 [INFO    ] Finished processing BAM request
2019-03-21 17:46:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93365   8 58563 63996027 A  ERROR'
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:46:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:46:36 [DEBUG   ] spawn_process: at 2019-03-21 17:46:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:46:37 [DEBUG   ] Got command BAM from MCS: ref #93366
2019-03-21 17:46:37 [INFO    ] Finished processing BAM request
2019-03-21 17:46:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93366   8 58563 63997031 A  ERROR'
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:46:37 [DEBUG   ] spawn_process: at 2019-03-21 17:46:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:46:42 [DEBUG   ] Got command RPT from MCS: ref #93369
2019-03-21 17:46:42 [DEBUG   ] summary = ERROR
2019-03-21 17:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93369  13 58563 64002963 A  ERRORERROR'
2019-03-21 17:46:43 [DEBUG   ] Got command RPT from MCS: ref #93370
2019-03-21 17:46:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93370  77 58563 64003167 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:46:43 [DEBUG   ] Got command RPT from MCS: ref #93371
2019-03-21 17:46:43 [DEBUG   ] summary = ERROR
2019-03-21 17:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93371  13 58563 64003371 A  ERRORERROR'
2019-03-21 17:46:43 [DEBUG   ] Got command RPT from MCS: ref #93373
2019-03-21 17:46:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93373  77 58563 64003575 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:46:43 [DEBUG   ] Got command RPT from MCS: ref #93374
2019-03-21 17:46:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93374  12 58563 64003767 A  ERRORBŸff'
2019-03-21 17:46:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:47:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:47:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:47:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:47:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:47:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:47:10 [DEBUG   ] Finished updating board flags in 1.216 seconds
2019-03-21 17:47:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:47:23 [DEBUG   ] Got command BAM from MCS: ref #93379
2019-03-21 17:47:23 [INFO    ] Finished processing BAM request
2019-03-21 17:47:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93379   8 58563 64043027 A  ERROR'
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:47:23 [DEBUG   ] spawn_process: at 2019-03-21 17:47:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:47:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:47:40 [DEBUG   ] Got command BAM from MCS: ref #93380
2019-03-21 17:47:40 [INFO    ] Finished processing BAM request
2019-03-21 17:47:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93380   8 58563 64060023 A  ERROR'
2019-03-21 17:47:40 [DEBUG   ] Got command RPT from MCS: ref #93381
2019-03-21 17:47:40 [DEBUG   ] summary = ERROR
2019-03-21 17:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93381  13 58563 64060815 A  ERRORERROR'
2019-03-21 17:47:40 [DEBUG   ] Got command RPT from MCS: ref #93382
2019-03-21 17:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93382  77 58563 64060815 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:47:40 [DEBUG   ] spawn_process: at 2019-03-21 17:47:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:47:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:48:09 [DEBUG   ] Got command BAM from MCS: ref #93404
2019-03-21 17:48:09 [INFO    ] Finished processing BAM request
2019-03-21 17:48:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93404   8 58563 64089023 A  ERROR'
2019-03-21 17:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:48:09 [DEBUG   ] spawn_process: at 2019-03-21 17:48:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:48:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:48:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:48:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:48:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:48:10 [DEBUG   ] Finished updating board flags in 1.176 seconds
2019-03-21 17:48:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-21 17:48:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:48:44 [DEBUG   ] Got command BAM from MCS: ref #93405
2019-03-21 17:48:44 [INFO    ] Finished processing BAM request
2019-03-21 17:48:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:48:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93405   8 58563 64124031 A  ERROR'
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:48:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:48:44 [DEBUG   ] spawn_process: at 2019-03-21 17:48:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:48:54 [DEBUG   ] Got command BAM from MCS: ref #93406
2019-03-21 17:48:54 [INFO    ] Finished processing BAM request
2019-03-21 17:48:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:48:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93406   8 58563 64134027 A  ERROR'
2019-03-21 17:48:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:48:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:48:54 [DEBUG   ] spawn_process: at 2019-03-21 17:48:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:49:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:49:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:49:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:49:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:49:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:49:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:49:10 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-03-21 17:49:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 17:49:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:49:39 [DEBUG   ] Got command BAM from MCS: ref #93407
2019-03-21 17:49:39 [INFO    ] Finished processing BAM request
2019-03-21 17:49:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93407   8 58563 64179031 A  ERROR'
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:49:39 [DEBUG   ] spawn_process: at 2019-03-21 17:49:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:49:48 [DEBUG   ] Got command BAM from MCS: ref #93408
2019-03-21 17:49:48 [INFO    ] Finished processing BAM request
2019-03-21 17:49:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:49:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93408   8 58563 64188027 A  ERROR'
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:49:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:49:48 [DEBUG   ] spawn_process: at 2019-03-21 17:49:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:49:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:50:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 17:50:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:50:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:50:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:50:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:50:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:50:10 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-03-21 17:50:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:50:24 [DEBUG   ] Got command BAM from MCS: ref #93409
2019-03-21 17:50:24 [INFO    ] Finished processing BAM request
2019-03-21 17:50:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93409   8 58563 64224031 A  ERROR'
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:50:24 [DEBUG   ] spawn_process: at 2019-03-21 17:50:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:50:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-21 17:50:52 [DEBUG   ] Got command BAM from MCS: ref #93416
2019-03-21 17:50:52 [INFO    ] Finished processing BAM request
2019-03-21 17:50:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:50:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93416   8 58563 64252023 A  ERROR'
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:50:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:50:52 [DEBUG   ] spawn_process: at 2019-03-21 17:50:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:50:54 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:51:09 [DEBUG   ] Got command BAM from MCS: ref #93417
2019-03-21 17:51:09 [INFO    ] Finished processing BAM request
2019-03-21 17:51:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93417   8 58563 64269031 A  ERROR'
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:51:09 [DEBUG   ] spawn_process: at 2019-03-21 17:51:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 17:51:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:51:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:51:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:51:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:51:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:51:10 [DEBUG   ] Finished updating board flags in 1.432 seconds
2019-03-21 17:51:14 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:51:34 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:51:43 [DEBUG   ] Got command RPT from MCS: ref #93418
2019-03-21 17:51:43 [DEBUG   ] summary = ERROR
2019-03-21 17:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93418  13 58563 64303051 A  ERRORERROR'
2019-03-21 17:51:43 [DEBUG   ] Got command RPT from MCS: ref #93419
2019-03-21 17:51:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93419  77 58563 64303255 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:51:43 [DEBUG   ] Got command RPT from MCS: ref #93420
2019-03-21 17:51:43 [DEBUG   ] summary = ERROR
2019-03-21 17:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93420  13 58563 64303459 A  ERRORERROR'
2019-03-21 17:51:43 [DEBUG   ] Got command RPT from MCS: ref #93421
2019-03-21 17:51:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93421  77 58563 64303651 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:51:43 [DEBUG   ] Got command RPT from MCS: ref #93422
2019-03-21 17:51:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93422  12 58563 64303855 A  ERRORBŸff'
2019-03-21 17:51:54 [DEBUG   ] Got command BAM from MCS: ref #93423
2019-03-21 17:51:54 [INFO    ] Finished processing BAM request
2019-03-21 17:51:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93423   8 58563 64314027 A  ERROR'
2019-03-21 17:51:54 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:51:54 [DEBUG   ] spawn_process: at 2019-03-21 17:51:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:51:56 [DEBUG   ] Got command BAM from MCS: ref #93424
2019-03-21 17:51:56 [INFO    ] Finished processing BAM request
2019-03-21 17:51:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93424   8 58563 64316023 A  ERROR'
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:51:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:51:56 [DEBUG   ] spawn_process: at 2019-03-21 17:51:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:52:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:52:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:52:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:52:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:52:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:52:10 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-03-21 17:52:14 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:52:34 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 17:52:39 [DEBUG   ] Got command BAM from MCS: ref #93425
2019-03-21 17:52:39 [INFO    ] Finished processing BAM request
2019-03-21 17:52:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93425   8 58563 64359031 A  ERROR'
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:52:39 [DEBUG   ] spawn_process: at 2019-03-21 17:52:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:52:40 [DEBUG   ] Got command RPT from MCS: ref #93426
2019-03-21 17:52:40 [DEBUG   ] summary = ERROR
2019-03-21 17:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93426  13 58563 64360807 A  ERRORERROR'
2019-03-21 17:52:40 [DEBUG   ] Got command RPT from MCS: ref #93427
2019-03-21 17:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93427  77 58563 64360807 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:52:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:53:00 [DEBUG   ] Got command BAM from MCS: ref #93443
2019-03-21 17:53:00 [INFO    ] Finished processing BAM request
2019-03-21 17:53:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93443   8 58563 64380027 A  ERROR'
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 17:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 17:53:00 [DEBUG   ] spawn_process: at 2019-03-21 17:53:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 17:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 17:53:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:53:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:53:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:53:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:53:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:53:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:53:11 [DEBUG   ] Finished updating board flags in 1.768 seconds
2019-03-21 17:53:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:53:23 [DEBUG   ] Got command BAM from MCS: ref #93444
2019-03-21 17:53:23 [INFO    ] Finished processing BAM request
2019-03-21 17:53:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93444   8 58563 64403027 A  ERROR'
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:53:23 [DEBUG   ] spawn_process: at 2019-03-21 17:53:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:53:35 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-21 17:53:55 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 17:54:04 [DEBUG   ] Got command BAM from MCS: ref #93451
2019-03-21 17:54:04 [INFO    ] Finished processing BAM request
2019-03-21 17:54:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:54:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93451   8 58563 64444027 A  ERROR'
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:54:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:54:04 [DEBUG   ] spawn_process: at 2019-03-21 17:54:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:54:07 [DEBUG   ] Got command BAM from MCS: ref #93452
2019-03-21 17:54:07 [INFO    ] Finished processing BAM request
2019-03-21 17:54:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:54:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93452   8 58563 64447031 A  ERROR'
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:54:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:54:07 [DEBUG   ] spawn_process: at 2019-03-21 17:54:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 17:54:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 17:54:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:54:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:54:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:54:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:54:10 [DEBUG   ] Finished updating board flags in 1.032 seconds
2019-03-21 17:54:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:54:35 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:54:51 [DEBUG   ] Got command BAM from MCS: ref #93453
2019-03-21 17:54:51 [INFO    ] Finished processing BAM request
2019-03-21 17:54:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93453   8 58563 64491031 A  ERROR'
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:54:51 [DEBUG   ] spawn_process: at 2019-03-21 17:54:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:54:55 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-21 17:55:08 [DEBUG   ] Got command BAM from MCS: ref #93454
2019-03-21 17:55:08 [INFO    ] Finished processing BAM request
2019-03-21 17:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93454   8 58563 64508031 A  ERROR'
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:55:08 [DEBUG   ] spawn_process: at 2019-03-21 17:55:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:55:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:55:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:55:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:55:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:55:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:55:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:55:10 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-03-21 17:55:15 [DEBUG   ] Finished updating ant stats in 0.392 seconds
2019-03-21 17:55:35 [DEBUG   ] Got command BAM from MCS: ref #93455
2019-03-21 17:55:35 [INFO    ] Finished processing BAM request
2019-03-21 17:55:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:55:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93455   8 58563 64535027 A  ERROR'
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:55:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:55:35 [DEBUG   ] spawn_process: at 2019-03-21 17:55:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:55:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 17:55:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 17:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 17:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 17:56:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:56:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:56:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:56:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:56:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:56:10 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-03-21 17:56:12 [DEBUG   ] Got command BAM from MCS: ref #93456
2019-03-21 17:56:12 [INFO    ] Finished processing BAM request
2019-03-21 17:56:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93456   8 58563 64572027 A  ERROR'
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 17:56:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 17:56:12 [DEBUG   ] spawn_process: at 2019-03-21 17:56:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 17:56:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:56:19 [DEBUG   ] Got command BAM from MCS: ref #93457
2019-03-21 17:56:19 [INFO    ] Finished processing BAM request
2019-03-21 17:56:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93457   8 58563 64579031 A  ERROR'
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 17:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 17:56:19 [DEBUG   ] spawn_process: at 2019-03-21 17:56:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 17:56:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 17:56:43 [DEBUG   ] Got command RPT from MCS: ref #93460
2019-03-21 17:56:43 [DEBUG   ] summary = ERROR
2019-03-21 17:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93460  13 58563 64603143 A  ERRORERROR'
2019-03-21 17:56:43 [DEBUG   ] Got command RPT from MCS: ref #93461
2019-03-21 17:56:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93461  77 58563 64603335 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:56:43 [DEBUG   ] Got command RPT from MCS: ref #93462
2019-03-21 17:56:43 [DEBUG   ] summary = ERROR
2019-03-21 17:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93462  13 58563 64603539 A  ERRORERROR'
2019-03-21 17:56:43 [DEBUG   ] Got command RPT from MCS: ref #93464
2019-03-21 17:56:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93464  77 58563 64603743 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:56:43 [DEBUG   ] Got command RPT from MCS: ref #93465
2019-03-21 17:56:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 17:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93465  12 58563 64603947 A  ERRORBžff'
2019-03-21 17:56:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:57:03 [DEBUG   ] Got command BAM from MCS: ref #93476
2019-03-21 17:57:03 [INFO    ] Finished processing BAM request
2019-03-21 17:57:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 17:57:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93476   8 58563 64623027 A  ERROR'
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 17:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 17:57:03 [DEBUG   ] spawn_process: at 2019-03-21 17:57:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 17:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 17:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 17:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:57:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:57:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:57:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:57:10 [WARNING ] (13, 1, 'bot')
2019-03-21 17:57:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:57:10 [DEBUG   ] Finished updating board flags in 0.987 seconds
2019-03-21 17:57:11 [DEBUG   ] Got command STP from MCS: ref #93477
2019-03-21 17:57:11 [INFO    ] Finished processing BAM request
2019-03-21 17:57:11 [INFO    ] Shutdown the adder chain on beam #3
2019-03-21 17:57:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    93477   8 58563 64631307 A  ERROR'
2019-03-21 17:57:11 [DEBUG   ] Got command STP from MCS: ref #93478
2019-03-21 17:57:11 [INFO    ] Finished processing BAM request
2019-03-21 17:57:11 [INFO    ] Shutdown the adder chain on beam #2
2019-03-21 17:57:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    93478   8 58563 64631311 A  ERROR'
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 17:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 17:57:11 [DEBUG   ] spawn_process: at 2019-03-21 17:57:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 17:57:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:57:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-21 17:57:40 [DEBUG   ] Got command RPT from MCS: ref #93479
2019-03-21 17:57:40 [DEBUG   ] summary = ERROR
2019-03-21 17:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93479  13 58563 64660811 A  ERRORERROR'
2019-03-21 17:57:40 [DEBUG   ] Got command RPT from MCS: ref #93480
2019-03-21 17:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 17:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93480  77 58563 64660811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 17:57:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:58:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:58:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:58:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:58:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:58:11 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-03-21 17:58:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 17:58:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-21 17:58:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 17:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 17:59:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:59:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:59:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:59:11 [WARNING ] (13, 1, 'bot')
2019-03-21 17:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 17:59:11 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-03-21 17:59:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:59:36 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 17:59:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-21 18:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:00:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 18:00:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:00:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:00:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:00:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:00:11 [DEBUG   ] Finished updating board flags in 1.342 seconds
2019-03-21 18:00:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:00:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 18:00:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 18:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:01:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:01:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:01:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:01:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:01:11 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-03-21 18:01:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-21 18:01:37 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 18:01:43 [DEBUG   ] Got command RPT from MCS: ref #93502
2019-03-21 18:01:43 [DEBUG   ] summary = ERROR
2019-03-21 18:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93502  13 58563 64903219 A  ERRORERROR'
2019-03-21 18:01:43 [DEBUG   ] Got command RPT from MCS: ref #93503
2019-03-21 18:01:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93503  77 58563 64903423 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:01:43 [DEBUG   ] Got command RPT from MCS: ref #93504
2019-03-21 18:01:43 [DEBUG   ] summary = ERROR
2019-03-21 18:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93504  13 58563 64903627 A  ERRORERROR'
2019-03-21 18:01:43 [DEBUG   ] Got command RPT from MCS: ref #93505
2019-03-21 18:01:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93505  77 58563 64903831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:01:44 [DEBUG   ] Got command RPT from MCS: ref #93506
2019-03-21 18:01:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93506  12 58563 64904023 A  ERRORB•™š'
2019-03-21 18:01:57 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 18:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:02:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:02:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:02:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:02:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:02:11 [DEBUG   ] Finished updating board flags in 1.185 seconds
2019-03-21 18:02:17 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-21 18:02:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:02:40 [DEBUG   ] Got command RPT from MCS: ref #93507
2019-03-21 18:02:40 [DEBUG   ] summary = ERROR
2019-03-21 18:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93507  13 58563 64960811 A  ERRORERROR'
2019-03-21 18:02:40 [DEBUG   ] Got command RPT from MCS: ref #93508
2019-03-21 18:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93508  77 58563 64960811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:02:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 18:03:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:03:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:03:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:03:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:03:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:03:11 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-03-21 18:03:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:03:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 18:03:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 18:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 18:04:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:04:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:04:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:04:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:04:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:04:11 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-03-21 18:04:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:04:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:04:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:05:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:05:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:05:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:05:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:05:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:05:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:05:12 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-03-21 18:05:17 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:05:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:05:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 18:06:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:06:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:06:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:06:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:06:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:06:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:06:11 [DEBUG   ] Finished updating board flags in 0.973 seconds
2019-03-21 18:06:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 18:06:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 18:06:43 [DEBUG   ] Got command RPT from MCS: ref #93538
2019-03-21 18:06:43 [DEBUG   ] summary = ERROR
2019-03-21 18:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93538  13 58563 65203315 A  ERRORERROR'
2019-03-21 18:06:43 [DEBUG   ] Got command RPT from MCS: ref #93539
2019-03-21 18:06:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93539  77 58563 65203507 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:06:43 [DEBUG   ] Got command RPT from MCS: ref #93540
2019-03-21 18:06:43 [DEBUG   ] summary = ERROR
2019-03-21 18:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93540  13 58563 65203711 A  ERRORERROR'
2019-03-21 18:06:43 [DEBUG   ] Got command RPT from MCS: ref #93542
2019-03-21 18:06:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93542  77 58563 65203915 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:06:44 [DEBUG   ] Got command RPT from MCS: ref #93543
2019-03-21 18:06:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93543  12 58563 65204119 A  ERRORB”™š'
2019-03-21 18:06:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 18:07:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:07:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:07:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:07:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:07:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:07:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:07:11 [DEBUG   ] Finished updating board flags in 1.267 seconds
2019-03-21 18:07:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 18:07:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 18:07:40 [DEBUG   ] Got command RPT from MCS: ref #93548
2019-03-21 18:07:40 [DEBUG   ] summary = ERROR
2019-03-21 18:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93548  13 58563 65260819 A  ERRORERROR'
2019-03-21 18:07:40 [DEBUG   ] Got command RPT from MCS: ref #93549
2019-03-21 18:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93549  77 58563 65260819 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:07:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:08:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:08:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:08:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:08:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:08:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:08:11 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-03-21 18:08:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:08:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 18:08:58 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:09:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:09:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:09:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:09:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:09:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:09:11 [DEBUG   ] Finished updating board flags in 1.168 seconds
2019-03-21 18:09:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 18:09:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 18:09:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 18:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:10:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:10:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:10:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:10:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:10:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:10:11 [DEBUG   ] Finished updating board flags in 1.040 seconds
2019-03-21 18:10:19 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-21 18:10:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 18:10:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:11:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:11:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:11:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:11:11 [WARNING ] (13, 1, 'bot')
2019-03-21 18:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:11:11 [DEBUG   ] Finished updating board flags in 0.976 seconds
2019-03-21 18:11:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:11:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:11:43 [DEBUG   ] Got command RPT from MCS: ref #93571
2019-03-21 18:11:43 [DEBUG   ] summary = ERROR
2019-03-21 18:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93571  13 58563 65503399 A  ERRORERROR'
2019-03-21 18:11:43 [DEBUG   ] Got command RPT from MCS: ref #93572
2019-03-21 18:11:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93572  77 58563 65503603 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:11:43 [DEBUG   ] Got command RPT from MCS: ref #93573
2019-03-21 18:11:43 [DEBUG   ] summary = ERROR
2019-03-21 18:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93573  13 58563 65503795 A  ERRORERROR'
2019-03-21 18:11:43 [DEBUG   ] Got command RPT from MCS: ref #93574
2019-03-21 18:11:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93574  77 58563 65503999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:11:44 [DEBUG   ] Got command RPT from MCS: ref #93575
2019-03-21 18:11:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93575  12 58563 65504203 A  ERRORB“™š'
2019-03-21 18:11:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 18:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:12:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:12:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:12:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:12:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:12:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:12:12 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-03-21 18:12:19 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:12:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 18:12:40 [DEBUG   ] Got command RPT from MCS: ref #93582
2019-03-21 18:12:40 [DEBUG   ] summary = ERROR
2019-03-21 18:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93582  13 58563 65560819 A  ERRORERROR'
2019-03-21 18:12:40 [DEBUG   ] Got command RPT from MCS: ref #93583
2019-03-21 18:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93583  77 58563 65560819 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:13:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 18:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:13:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:13:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:13:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:13:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:13:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:13:12 [DEBUG   ] Finished updating board flags in 1.186 seconds
2019-03-21 18:13:20 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 18:13:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 18:14:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 18:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:14:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-21 18:14:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:14:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:14:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:14:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:14:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:14:12 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-03-21 18:14:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 18:14:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 18:15:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 18:15:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:15:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:15:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:15:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:15:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:15:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:15:12 [DEBUG   ] Finished updating board flags in 1.029 seconds
2019-03-21 18:15:20 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-21 18:15:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:16:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:16:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:16:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:16:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:16:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:16:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:16:12 [DEBUG   ] Finished updating board flags in 1.468 seconds
2019-03-21 18:16:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-21 18:16:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:16:43 [DEBUG   ] Got command RPT from MCS: ref #93607
2019-03-21 18:16:43 [DEBUG   ] summary = ERROR
2019-03-21 18:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93607  13 58563 65803479 A  ERRORERROR'
2019-03-21 18:16:43 [DEBUG   ] Got command RPT from MCS: ref #93608
2019-03-21 18:16:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93608  77 58563 65803683 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:16:43 [DEBUG   ] Got command RPT from MCS: ref #93609
2019-03-21 18:16:43 [DEBUG   ] summary = ERROR
2019-03-21 18:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93609  13 58563 65803887 A  ERRORERROR'
2019-03-21 18:16:44 [DEBUG   ] Got command RPT from MCS: ref #93611
2019-03-21 18:16:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93611  77 58563 65804091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:16:44 [DEBUG   ] Got command RPT from MCS: ref #93612
2019-03-21 18:16:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93612  12 58563 65804283 A  ERRORB“™š'
2019-03-21 18:17:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:17:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:17:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:17:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:17:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:17:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:17:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:17:12 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-03-21 18:17:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:17:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:17:40 [DEBUG   ] Got command RPT from MCS: ref #93617
2019-03-21 18:17:40 [DEBUG   ] summary = ERROR
2019-03-21 18:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93617  13 58563 65860823 A  ERRORERROR'
2019-03-21 18:17:40 [DEBUG   ] Got command RPT from MCS: ref #93618
2019-03-21 18:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93618  77 58563 65860823 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:18:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 18:18:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:18:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:18:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:18:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:18:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:18:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:18:12 [DEBUG   ] Finished updating board flags in 1.198 seconds
2019-03-21 18:18:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 18:18:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 18:19:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 18:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:19:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-21 18:19:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:19:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:19:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:19:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:19:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:19:12 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-03-21 18:19:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 18:19:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 18:20:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-21 18:20:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:20:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:20:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:20:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:20:12 [WARNING ] (13, 1, 'bot')
2019-03-21 18:20:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:20:12 [DEBUG   ] Finished updating board flags in 0.981 seconds
2019-03-21 18:20:21 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2019-03-21 18:20:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:21:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-21 18:21:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:21:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:21:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:21:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:21:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:21:13 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-03-21 18:21:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:21:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:21:43 [DEBUG   ] Got command RPT from MCS: ref #93690
2019-03-21 18:21:43 [DEBUG   ] summary = ERROR
2019-03-21 18:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93690  13 58563 66103571 A  ERRORERROR'
2019-03-21 18:21:43 [DEBUG   ] Got command RPT from MCS: ref #93691
2019-03-21 18:21:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93691  77 58563 66103775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:21:43 [DEBUG   ] Got command RPT from MCS: ref #93692
2019-03-21 18:21:43 [DEBUG   ] summary = ERROR
2019-03-21 18:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93692  13 58563 66103967 A  ERRORERROR'
2019-03-21 18:21:44 [DEBUG   ] Got command RPT from MCS: ref #93693
2019-03-21 18:21:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93693  77 58563 66104171 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:21:44 [DEBUG   ] Got command RPT from MCS: ref #93694
2019-03-21 18:21:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93694  12 58563 66104375 A  ERRORB‘™š'
2019-03-21 18:22:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:22:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:22:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:22:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:22:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:22:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:22:13 [DEBUG   ] Finished updating board flags in 1.246 seconds
2019-03-21 18:22:21 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:22:40 [DEBUG   ] Got command RPT from MCS: ref #93695
2019-03-21 18:22:40 [DEBUG   ] summary = ERROR
2019-03-21 18:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93695  13 58563 66160815 A  ERRORERROR'
2019-03-21 18:22:40 [DEBUG   ] Got command RPT from MCS: ref #93696
2019-03-21 18:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93696  77 58563 66160815 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:22:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:23:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:23:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:23:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:23:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:23:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:23:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:23:13 [DEBUG   ] Finished updating board flags in 1.177 seconds
2019-03-21 18:23:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 18:23:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:24:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 18:24:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-21 18:24:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:24:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:24:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:24:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:24:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:24:14 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-03-21 18:24:21 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-03-21 18:24:41 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 18:25:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 18:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-21 18:25:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:25:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:25:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:25:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:25:13 [DEBUG   ] Finished updating board flags in 0.971 seconds
2019-03-21 18:25:21 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:25:41 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:26:01 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 18:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:26:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:26:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:26:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:26:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:26:13 [DEBUG   ] Finished updating board flags in 1.283 seconds
2019-03-21 18:26:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 18:26:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:26:43 [DEBUG   ] Got command RPT from MCS: ref #93720
2019-03-21 18:26:43 [DEBUG   ] summary = ERROR
2019-03-21 18:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93720  13 58563 66403651 A  ERRORERROR'
2019-03-21 18:26:43 [DEBUG   ] Got command RPT from MCS: ref #93721
2019-03-21 18:26:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93721  77 58563 66403855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:26:44 [DEBUG   ] Got command RPT from MCS: ref #93722
2019-03-21 18:26:44 [DEBUG   ] summary = ERROR
2019-03-21 18:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93722  13 58563 66404059 A  ERRORERROR'
2019-03-21 18:26:44 [DEBUG   ] Got command RPT from MCS: ref #93724
2019-03-21 18:26:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93724  77 58563 66404251 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:26:44 [DEBUG   ] Got command RPT from MCS: ref #93725
2019-03-21 18:26:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93725  12 58563 66404455 A  ERRORB�™š'
2019-03-21 18:27:02 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-21 18:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:27:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-21 18:27:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:27:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:27:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:27:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:27:13 [DEBUG   ] Finished updating board flags in 1.173 seconds
2019-03-21 18:27:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 18:27:40 [DEBUG   ] Got command RPT from MCS: ref #93736
2019-03-21 18:27:40 [DEBUG   ] summary = ERROR
2019-03-21 18:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93736  13 58563 66460815 A  ERRORERROR'
2019-03-21 18:27:40 [DEBUG   ] Got command RPT from MCS: ref #93737
2019-03-21 18:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93737  77 58563 66460815 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:27:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:28:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:28:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:28:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:28:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:28:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:28:13 [WARNING ] (13, 1, 'bot')
2019-03-21 18:28:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:28:13 [DEBUG   ] Finished updating board flags in 1.033 seconds
2019-03-21 18:28:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 18:28:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 18:29:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:29:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:29:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:29:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:29:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:29:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:29:14 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-03-21 18:29:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 18:29:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 18:29:58 [DEBUG   ] Got command DRX from MCS: ref #93764
2019-03-21 18:29:58 [INFO    ] sending drx command to lwa16
2019-03-21 18:29:58 [DEBUG   ] run_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 58000000.0 7 8 0']
2019-03-21 18:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 18:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    93764   8 58563 66598011 A  ERROR'
2019-03-21 18:29:58 [DEBUG   ] Got command DRX from MCS: ref #93763
2019-03-21 18:29:58 [INFO    ] sending drx command to lwa34
2019-03-21 18:29:58 [DEBUG   ] run_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 24000000.0 7 8 0']
2019-03-21 18:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 18:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    93763   8 58563 66598015 A  ERROR'
2019-03-21 18:29:58 [DEBUG   ] Got command DRX from MCS: ref #93765
2019-03-21 18:29:58 [INFO    ] sending drx command to lwa34
2019-03-21 18:29:58 [DEBUG   ] run_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 41000000.0 7 8 0']
2019-03-21 18:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 18:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    93765   8 58563 66598019 A  ERROR'
2019-03-21 18:29:58 [DEBUG   ] Got command DRX from MCS: ref #93766
2019-03-21 18:29:58 [INFO    ] sending drx command to lwa16
2019-03-21 18:29:58 [DEBUG   ] run_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 75000000.0 7 8 0']
2019-03-21 18:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 18:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    93766   8 58563 66598023 A  ERROR'
2019-03-21 18:29:58 [DEBUG   ] Got command BAM from MCS: ref #93767
2019-03-21 18:29:58 [INFO    ] Finished processing BAM request
2019-03-21 18:29:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93767   8 58563 66598027 A  ERROR'
2019-03-21 18:29:58 [DEBUG   ] Got command BAM from MCS: ref #93768
2019-03-21 18:29:58 [INFO    ] Finished processing BAM request
2019-03-21 18:29:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93768   8 58563 66598031 A  ERROR'
2019-03-21 18:29:58 [INFO    ] Finished starting DRX
2019-03-21 18:29:58 [INFO    ] Finished starting DRX
2019-03-21 18:29:58 [INFO    ] Finished starting DRX
2019-03-21 18:29:58 [INFO    ] Finished starting DRX
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:29:58 [DEBUG   ] spawn_process: at 2019-03-21 18:29:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:30:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 18:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:30:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-21 18:30:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:30:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:30:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:30:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:30:14 [DEBUG   ] Finished updating board flags in 1.192 seconds
2019-03-21 18:30:22 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 18:30:42 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:31:02 [DEBUG   ] Got command BAM from MCS: ref #93771
2019-03-21 18:31:02 [INFO    ] Finished processing BAM request
2019-03-21 18:31:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93771   8 58563 66662027 A  ERROR'
2019-03-21 18:31:02 [DEBUG   ] Got command BAM from MCS: ref #93772
2019-03-21 18:31:02 [INFO    ] Finished processing BAM request
2019-03-21 18:31:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93772   8 58563 66662031 A  ERROR'
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:31:02 [DEBUG   ] spawn_process: at 2019-03-21 18:31:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:31:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 18:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:31:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-21 18:31:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:31:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:31:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:31:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:31:14 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-03-21 18:31:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 18:31:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 18:31:43 [DEBUG   ] Got command RPT from MCS: ref #93773
2019-03-21 18:31:43 [DEBUG   ] summary = ERROR
2019-03-21 18:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93773  13 58563 66703735 A  ERRORERROR'
2019-03-21 18:31:43 [DEBUG   ] Got command RPT from MCS: ref #93774
2019-03-21 18:31:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93774  77 58563 66703939 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:31:44 [DEBUG   ] Got command RPT from MCS: ref #93775
2019-03-21 18:31:44 [DEBUG   ] summary = ERROR
2019-03-21 18:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93775  13 58563 66704143 A  ERRORERROR'
2019-03-21 18:31:44 [DEBUG   ] Got command RPT from MCS: ref #93776
2019-03-21 18:31:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93776  77 58563 66704335 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:31:44 [DEBUG   ] Got command RPT from MCS: ref #93777
2019-03-21 18:31:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93777  12 58563 66704539 A  ERRORB•™š'
2019-03-21 18:32:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:32:06 [DEBUG   ] Got command BAM from MCS: ref #93778
2019-03-21 18:32:06 [INFO    ] Finished processing BAM request
2019-03-21 18:32:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:32:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93778   8 58563 66726031 A  ERROR'
2019-03-21 18:32:06 [DEBUG   ] Got command BAM from MCS: ref #93779
2019-03-21 18:32:06 [INFO    ] Finished processing BAM request
2019-03-21 18:32:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:32:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93779   8 58563 66726035 A  ERROR'
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 18:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 18:32:06 [DEBUG   ] spawn_process: at 2019-03-21 18:32:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 18:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:32:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:32:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:32:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:32:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:32:14 [DEBUG   ] Finished updating board flags in 0.996 seconds
2019-03-21 18:32:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:32:40 [DEBUG   ] Got command RPT from MCS: ref #93780
2019-03-21 18:32:40 [DEBUG   ] summary = ERROR
2019-03-21 18:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93780  13 58563 66760823 A  ERRORERROR'
2019-03-21 18:32:40 [DEBUG   ] Got command RPT from MCS: ref #93781
2019-03-21 18:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93781  77 58563 66760823 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:32:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:33:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:33:10 [DEBUG   ] Got command BAM from MCS: ref #93804
2019-03-21 18:33:10 [INFO    ] Finished processing BAM request
2019-03-21 18:33:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93804   8 58563 66790031 A  ERROR'
2019-03-21 18:33:10 [DEBUG   ] Got command BAM from MCS: ref #93803
2019-03-21 18:33:10 [INFO    ] Finished processing BAM request
2019-03-21 18:33:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93803   8 58563 66790035 A  ERROR'
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:33:10 [DEBUG   ] spawn_process: at 2019-03-21 18:33:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:33:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:33:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:33:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:33:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:33:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:33:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:33:14 [DEBUG   ] Finished updating board flags in 1.264 seconds
2019-03-21 18:33:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:33:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 18:34:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:34:14 [DEBUG   ] Got command BAM from MCS: ref #93805
2019-03-21 18:34:14 [INFO    ] Finished processing BAM request
2019-03-21 18:34:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93805   8 58563 66854027 A  ERROR'
2019-03-21 18:34:14 [DEBUG   ] Got command BAM from MCS: ref #93806
2019-03-21 18:34:14 [INFO    ] Finished processing BAM request
2019-03-21 18:34:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93806   8 58563 66854031 A  ERROR'
2019-03-21 18:34:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:34:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 18:34:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:34:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:34:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:34:14 [WARNING ] (13, 1, 'bot')
2019-03-21 18:34:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:34:14 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:34:14 [DEBUG   ] spawn_process: at 2019-03-21 18:34:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:34:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:34:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:34:58 [DEBUG   ] Got command BAM from MCS: ref #93807
2019-03-21 18:34:58 [INFO    ] Finished processing BAM request
2019-03-21 18:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93807   8 58563 66898027 A  ERROR'
2019-03-21 18:34:58 [DEBUG   ] Got command BAM from MCS: ref #93808
2019-03-21 18:34:58 [INFO    ] Finished processing BAM request
2019-03-21 18:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93808   8 58563 66898031 A  ERROR'
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:34:58 [DEBUG   ] spawn_process: at 2019-03-21 18:34:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:35:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:35:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:35:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:35:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:35:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:35:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:35:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:35:15 [DEBUG   ] Finished updating board flags in 1.632 seconds
2019-03-21 18:35:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 18:35:27 [DEBUG   ] Got command BAM from MCS: ref #93812
2019-03-21 18:35:27 [INFO    ] Finished processing BAM request
2019-03-21 18:35:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93812   8 58563 66927027 A  ERROR'
2019-03-21 18:35:27 [DEBUG   ] Got command BAM from MCS: ref #93811
2019-03-21 18:35:27 [INFO    ] Finished processing BAM request
2019-03-21 18:35:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93811   8 58563 66927031 A  ERROR'
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:35:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:35:27 [DEBUG   ] spawn_process: at 2019-03-21 18:35:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:35:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:35:56 [DEBUG   ] Got command BAM from MCS: ref #93819
2019-03-21 18:35:56 [INFO    ] Finished processing BAM request
2019-03-21 18:35:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:35:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93819   8 58563 66956027 A  ERROR'
2019-03-21 18:35:56 [DEBUG   ] Got command BAM from MCS: ref #93820
2019-03-21 18:35:56 [INFO    ] Finished processing BAM request
2019-03-21 18:35:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:35:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93820   8 58563 66956031 A  ERROR'
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:35:56 [DEBUG   ] spawn_process: at 2019-03-21 18:35:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:36:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:36:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:36:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:36:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:36:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:36:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:36:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:36:15 [DEBUG   ] Finished updating board flags in 1.516 seconds
2019-03-21 18:36:24 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2019-03-21 18:36:25 [DEBUG   ] Got command BAM from MCS: ref #93822
2019-03-21 18:36:25 [INFO    ] Finished processing BAM request
2019-03-21 18:36:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:36:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93822   8 58563 66985023 A  ERROR'
2019-03-21 18:36:25 [DEBUG   ] Got command BAM from MCS: ref #93821
2019-03-21 18:36:25 [INFO    ] Finished processing BAM request
2019-03-21 18:36:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:36:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93821   8 58563 66985031 A  ERROR'
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:36:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:36:25 [DEBUG   ] spawn_process: at 2019-03-21 18:36:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:36:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 18:36:43 [DEBUG   ] Got command RPT from MCS: ref #93825
2019-03-21 18:36:43 [DEBUG   ] summary = ERROR
2019-03-21 18:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93825  13 58563 67003823 A  ERRORERROR'
2019-03-21 18:36:44 [DEBUG   ] Got command RPT from MCS: ref #93826
2019-03-21 18:36:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93826  77 58563 67004027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:36:44 [DEBUG   ] Got command RPT from MCS: ref #93827
2019-03-21 18:36:44 [DEBUG   ] summary = ERROR
2019-03-21 18:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93827  13 58563 67004223 A  ERRORERROR'
2019-03-21 18:36:44 [DEBUG   ] Got command RPT from MCS: ref #93829
2019-03-21 18:36:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93829  77 58563 67004427 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:36:44 [DEBUG   ] Got command RPT from MCS: ref #93830
2019-03-21 18:36:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93830  12 58563 67004631 A  ERRORB˜™š'
2019-03-21 18:36:54 [DEBUG   ] Got command BAM from MCS: ref #93836
2019-03-21 18:36:54 [INFO    ] Finished processing BAM request
2019-03-21 18:36:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93836   8 58563 67014031 A  ERROR'
2019-03-21 18:36:54 [DEBUG   ] Got command BAM from MCS: ref #93835
2019-03-21 18:36:54 [INFO    ] Finished processing BAM request
2019-03-21 18:36:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93835   8 58563 67014035 A  ERROR'
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:36:54 [DEBUG   ] spawn_process: at 2019-03-21 18:36:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:37:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:37:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:37:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 18:37:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 18:37:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:37:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:37:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:37:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:37:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:37:15 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-03-21 18:37:23 [DEBUG   ] Got command BAM from MCS: ref #93838
2019-03-21 18:37:23 [INFO    ] Finished processing BAM request
2019-03-21 18:37:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93838   8 58563 67043023 A  ERROR'
2019-03-21 18:37:23 [DEBUG   ] Got command BAM from MCS: ref #93837
2019-03-21 18:37:23 [INFO    ] Finished processing BAM request
2019-03-21 18:37:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93837   8 58563 67043027 A  ERROR'
2019-03-21 18:37:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:37:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:37:23 [DEBUG   ] spawn_process: at 2019-03-21 18:37:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:37:40 [DEBUG   ] Got command RPT from MCS: ref #93839
2019-03-21 18:37:40 [DEBUG   ] summary = ERROR
2019-03-21 18:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93839  13 58563 67060823 A  ERRORERROR'
2019-03-21 18:37:40 [DEBUG   ] Got command RPT from MCS: ref #93840
2019-03-21 18:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93840  77 58563 67060823 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:37:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:37:52 [DEBUG   ] Got command BAM from MCS: ref #93856
2019-03-21 18:37:52 [INFO    ] Finished processing BAM request
2019-03-21 18:37:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:37:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93856   8 58563 67072031 A  ERROR'
2019-03-21 18:37:52 [DEBUG   ] Got command BAM from MCS: ref #93857
2019-03-21 18:37:52 [INFO    ] Finished processing BAM request
2019-03-21 18:37:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:37:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93857   8 58563 67072035 A  ERROR'
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:37:52 [DEBUG   ] spawn_process: at 2019-03-21 18:37:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:38:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 18:38:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:38:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-21 18:38:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:38:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:38:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:38:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:38:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:38:15 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-03-21 18:38:21 [DEBUG   ] Got command BAM from MCS: ref #93858
2019-03-21 18:38:21 [INFO    ] Finished processing BAM request
2019-03-21 18:38:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93858   8 58563 67101027 A  ERROR'
2019-03-21 18:38:21 [DEBUG   ] Got command BAM from MCS: ref #93859
2019-03-21 18:38:21 [INFO    ] Finished processing BAM request
2019-03-21 18:38:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93859   8 58563 67101031 A  ERROR'
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:38:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:38:21 [DEBUG   ] spawn_process: at 2019-03-21 18:38:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:38:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:38:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:38:50 [DEBUG   ] Got command BAM from MCS: ref #93867
2019-03-21 18:38:50 [INFO    ] Finished processing BAM request
2019-03-21 18:38:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93867   8 58563 67130031 A  ERROR'
2019-03-21 18:38:50 [DEBUG   ] Got command BAM from MCS: ref #93866
2019-03-21 18:38:50 [INFO    ] Finished processing BAM request
2019-03-21 18:38:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93866   8 58563 67130035 A  ERROR'
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 18:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 18:38:50 [DEBUG   ] spawn_process: at 2019-03-21 18:38:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 18:39:04 [DEBUG   ] Finished updating ant stats in 1.600 seconds
2019-03-21 18:39:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:39:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:39:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:39:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:39:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:39:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:39:15 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-03-21 18:39:19 [DEBUG   ] Got command BAM from MCS: ref #93869
2019-03-21 18:39:19 [INFO    ] Finished processing BAM request
2019-03-21 18:39:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:39:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93869   8 58563 67159023 A  ERROR'
2019-03-21 18:39:19 [DEBUG   ] Got command BAM from MCS: ref #93868
2019-03-21 18:39:19 [INFO    ] Finished processing BAM request
2019-03-21 18:39:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:39:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93868   8 58563 67159027 A  ERROR'
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 18:39:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 18:39:19 [DEBUG   ] spawn_process: at 2019-03-21 18:39:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 18:39:23 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 18:39:43 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 18:39:48 [DEBUG   ] Got command BAM from MCS: ref #93870
2019-03-21 18:39:48 [INFO    ] Finished processing BAM request
2019-03-21 18:39:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:39:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93870   8 58563 67188031 A  ERROR'
2019-03-21 18:39:48 [DEBUG   ] Got command BAM from MCS: ref #93871
2019-03-21 18:39:48 [INFO    ] Finished processing BAM request
2019-03-21 18:39:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:39:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93871   8 58563 67188035 A  ERROR'
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 18:39:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 18:39:48 [DEBUG   ] spawn_process: at 2019-03-21 18:39:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 18:40:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 18:40:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:40:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:40:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:40:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:40:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:40:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:40:15 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-03-21 18:40:17 [DEBUG   ] Got command BAM from MCS: ref #93873
2019-03-21 18:40:17 [INFO    ] Finished processing BAM request
2019-03-21 18:40:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93873   8 58563 67217027 A  ERROR'
2019-03-21 18:40:17 [DEBUG   ] Got command BAM from MCS: ref #93872
2019-03-21 18:40:17 [INFO    ] Finished processing BAM request
2019-03-21 18:40:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93872   8 58563 67217031 A  ERROR'
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:40:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:40:17 [DEBUG   ] spawn_process: at 2019-03-21 18:40:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:40:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 18:40:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 18:40:46 [DEBUG   ] Got command BAM from MCS: ref #93875
2019-03-21 18:40:46 [INFO    ] Finished processing BAM request
2019-03-21 18:40:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:40:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93875   8 58563 67246023 A  ERROR'
2019-03-21 18:40:46 [DEBUG   ] Got command BAM from MCS: ref #93874
2019-03-21 18:40:46 [INFO    ] Finished processing BAM request
2019-03-21 18:40:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:40:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93874   8 58563 67246027 A  ERROR'
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 18:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 18:40:46 [DEBUG   ] spawn_process: at 2019-03-21 18:40:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 18:41:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:41:15 [DEBUG   ] Got command BAM from MCS: ref #93876
2019-03-21 18:41:15 [INFO    ] Finished processing BAM request
2019-03-21 18:41:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:41:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93876   8 58563 67275035 A  ERROR'
2019-03-21 18:41:15 [DEBUG   ] Got command BAM from MCS: ref #93877
2019-03-21 18:41:15 [INFO    ] Finished processing BAM request
2019-03-21 18:41:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:41:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93877   8 58563 67275039 A  ERROR'
2019-03-21 18:41:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:41:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:41:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:41:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:41:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:41:15 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:41:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:41:15 [DEBUG   ] spawn_process: at 2019-03-21 18:41:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:41:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:41:43 [DEBUG   ] Got command RPT from MCS: ref #93880
2019-03-21 18:41:43 [DEBUG   ] summary = ERROR
2019-03-21 18:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93880  13 58563 67303911 A  ERRORERROR'
2019-03-21 18:41:44 [DEBUG   ] Got command BAM from MCS: ref #93878
2019-03-21 18:41:44 [INFO    ] Finished processing BAM request
2019-03-21 18:41:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93878   8 58563 67304023 A  ERROR'
2019-03-21 18:41:44 [DEBUG   ] Got command BAM from MCS: ref #93879
2019-03-21 18:41:44 [INFO    ] Finished processing BAM request
2019-03-21 18:41:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93879   8 58563 67304027 A  ERROR'
2019-03-21 18:41:44 [DEBUG   ] Got command RPT from MCS: ref #93881
2019-03-21 18:41:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93881  77 58563 67304111 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:41:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 18:41:44 [DEBUG   ] Got command RPT from MCS: ref #93882
2019-03-21 18:41:44 [DEBUG   ] summary = ERROR
2019-03-21 18:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93882  13 58563 67304315 A  ERRORERROR'
2019-03-21 18:41:44 [DEBUG   ] Got command RPT from MCS: ref #93883
2019-03-21 18:41:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93883  77 58563 67304519 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:41:44 [DEBUG   ] Got command RPT from MCS: ref #93884
2019-03-21 18:41:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93884  12 58563 67304711 A  ERRORB˜™š'
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:41:44 [DEBUG   ] spawn_process: at 2019-03-21 18:41:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:42:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 18:42:13 [DEBUG   ] Got command BAM from MCS: ref #93891
2019-03-21 18:42:13 [INFO    ] Finished processing BAM request
2019-03-21 18:42:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93891   8 58563 67333031 A  ERROR'
2019-03-21 18:42:13 [DEBUG   ] Got command BAM from MCS: ref #93892
2019-03-21 18:42:13 [INFO    ] Finished processing BAM request
2019-03-21 18:42:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:42:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93892   8 58563 67333035 A  ERROR'
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:42:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:42:13 [DEBUG   ] spawn_process: at 2019-03-21 18:42:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:42:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:42:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2019-03-21 18:42:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:42:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:42:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:42:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:42:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:42:15 [DEBUG   ] Finished updating board flags in 1.220 seconds
2019-03-21 18:42:24 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-03-21 18:42:40 [DEBUG   ] Got command RPT from MCS: ref #93893
2019-03-21 18:42:40 [DEBUG   ] summary = ERROR
2019-03-21 18:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93893  13 58563 67360819 A  ERRORERROR'
2019-03-21 18:42:40 [DEBUG   ] Got command RPT from MCS: ref #93894
2019-03-21 18:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93894  77 58563 67360819 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:42:42 [DEBUG   ] Got command BAM from MCS: ref #93911
2019-03-21 18:42:42 [INFO    ] Finished processing BAM request
2019-03-21 18:42:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:42:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93911   8 58563 67362023 A  ERROR'
2019-03-21 18:42:42 [DEBUG   ] Got command BAM from MCS: ref #93910
2019-03-21 18:42:42 [INFO    ] Finished processing BAM request
2019-03-21 18:42:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:42:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93910   8 58563 67362027 A  ERROR'
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:42:42 [DEBUG   ] spawn_process: at 2019-03-21 18:42:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:42:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:43:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 18:43:11 [DEBUG   ] Got command BAM from MCS: ref #93912
2019-03-21 18:43:11 [INFO    ] Finished processing BAM request
2019-03-21 18:43:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93912   8 58563 67391023 A  ERROR'
2019-03-21 18:43:11 [DEBUG   ] Got command BAM from MCS: ref #93913
2019-03-21 18:43:11 [INFO    ] Finished processing BAM request
2019-03-21 18:43:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93913   8 58563 67391027 A  ERROR'
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:43:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:43:11 [DEBUG   ] spawn_process: at 2019-03-21 18:43:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:43:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:43:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:43:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:43:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:43:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:43:15 [DEBUG   ] Finished updating board flags in 1.176 seconds
2019-03-21 18:43:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:43:39 [DEBUG   ] Got command BAM from MCS: ref #93915
2019-03-21 18:43:39 [INFO    ] Finished processing BAM request
2019-03-21 18:43:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93915   8 58563 67419031 A  ERROR'
2019-03-21 18:43:39 [DEBUG   ] Got command BAM from MCS: ref #93914
2019-03-21 18:43:39 [INFO    ] Finished processing BAM request
2019-03-21 18:43:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93914   8 58563 67419035 A  ERROR'
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:43:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:43:39 [DEBUG   ] spawn_process: at 2019-03-21 18:43:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:43:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:44:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:44:07 [DEBUG   ] Got command BAM from MCS: ref #93917
2019-03-21 18:44:07 [INFO    ] Finished processing BAM request
2019-03-21 18:44:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:44:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93917   8 58563 67447023 A  ERROR'
2019-03-21 18:44:07 [DEBUG   ] Got command BAM from MCS: ref #93916
2019-03-21 18:44:07 [INFO    ] Finished processing BAM request
2019-03-21 18:44:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:44:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93916   8 58563 67447027 A  ERROR'
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:44:07 [DEBUG   ] spawn_process: at 2019-03-21 18:44:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:44:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2019-03-21 18:44:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:44:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:44:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:44:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:44:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:44:15 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-03-21 18:44:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:44:35 [DEBUG   ] Got command BAM from MCS: ref #93919
2019-03-21 18:44:35 [INFO    ] Finished processing BAM request
2019-03-21 18:44:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:44:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93919   8 58563 67475023 A  ERROR'
2019-03-21 18:44:35 [DEBUG   ] Got command BAM from MCS: ref #93918
2019-03-21 18:44:35 [INFO    ] Finished processing BAM request
2019-03-21 18:44:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:44:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93918   8 58563 67475027 A  ERROR'
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:44:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:44:35 [DEBUG   ] spawn_process: at 2019-03-21 18:44:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:44:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 18:45:03 [DEBUG   ] Got command BAM from MCS: ref #93926
2019-03-21 18:45:03 [INFO    ] Finished processing BAM request
2019-03-21 18:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93926   8 58563 67503031 A  ERROR'
2019-03-21 18:45:03 [DEBUG   ] Got command BAM from MCS: ref #93927
2019-03-21 18:45:03 [INFO    ] Finished processing BAM request
2019-03-21 18:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93927   8 58563 67503035 A  ERROR'
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:45:03 [DEBUG   ] spawn_process: at 2019-03-21 18:45:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:45:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:45:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:45:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:45:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:45:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:45:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:45:15 [DEBUG   ] Finished updating board flags in 1.087 seconds
2019-03-21 18:45:24 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 18:45:31 [DEBUG   ] Got command BAM from MCS: ref #93929
2019-03-21 18:45:31 [INFO    ] Finished processing BAM request
2019-03-21 18:45:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93929   8 58563 67531027 A  ERROR'
2019-03-21 18:45:31 [DEBUG   ] Got command BAM from MCS: ref #93928
2019-03-21 18:45:31 [INFO    ] Finished processing BAM request
2019-03-21 18:45:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93928   8 58563 67531031 A  ERROR'
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:45:31 [DEBUG   ] spawn_process: at 2019-03-21 18:45:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:45:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 18:45:59 [DEBUG   ] Got command BAM from MCS: ref #93931
2019-03-21 18:45:59 [INFO    ] Finished processing BAM request
2019-03-21 18:45:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93931   8 58563 67559031 A  ERROR'
2019-03-21 18:45:59 [DEBUG   ] Got command BAM from MCS: ref #93930
2019-03-21 18:45:59 [INFO    ] Finished processing BAM request
2019-03-21 18:45:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93930   8 58563 67559035 A  ERROR'
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:45:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:45:59 [DEBUG   ] spawn_process: at 2019-03-21 18:45:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:46:04 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 18:46:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:46:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:46:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:46:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:46:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:46:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:46:16 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-03-21 18:46:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 18:46:27 [DEBUG   ] Got command BAM from MCS: ref #93933
2019-03-21 18:46:27 [INFO    ] Finished processing BAM request
2019-03-21 18:46:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93933   8 58563 67587027 A  ERROR'
2019-03-21 18:46:27 [DEBUG   ] Got command BAM from MCS: ref #93932
2019-03-21 18:46:27 [INFO    ] Finished processing BAM request
2019-03-21 18:46:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93932   8 58563 67587031 A  ERROR'
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:46:27 [DEBUG   ] spawn_process: at 2019-03-21 18:46:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:46:43 [DEBUG   ] Got command RPT from MCS: ref #93936
2019-03-21 18:46:43 [DEBUG   ] summary = ERROR
2019-03-21 18:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93936  13 58563 67603999 A  ERRORERROR'
2019-03-21 18:46:44 [DEBUG   ] Got command RPT from MCS: ref #93937
2019-03-21 18:46:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93937  77 58563 67604203 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:46:44 [DEBUG   ] Got command RPT from MCS: ref #93938
2019-03-21 18:46:44 [DEBUG   ] summary = ERROR
2019-03-21 18:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93938  13 58563 67604399 A  ERRORERROR'
2019-03-21 18:46:44 [DEBUG   ] Got command RPT from MCS: ref #93940
2019-03-21 18:46:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93940  77 58563 67604603 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:46:44 [DEBUG   ] Got command RPT from MCS: ref #93942
2019-03-21 18:46:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93942  12 58563 67604795 A  ERRORB™™š'
2019-03-21 18:46:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 18:46:55 [DEBUG   ] Got command BAM from MCS: ref #93947
2019-03-21 18:46:55 [INFO    ] Finished processing BAM request
2019-03-21 18:46:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93947   8 58563 67615023 A  ERROR'
2019-03-21 18:46:55 [DEBUG   ] Got command BAM from MCS: ref #93946
2019-03-21 18:46:55 [INFO    ] Finished processing BAM request
2019-03-21 18:46:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93946   8 58563 67615027 A  ERROR'
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 18:46:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 18:46:55 [DEBUG   ] spawn_process: at 2019-03-21 18:46:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 18:47:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 18:47:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:47:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2019-03-21 18:47:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:47:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:47:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:47:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:47:15 [DEBUG   ] Finished updating board flags in 1.170 seconds
2019-03-21 18:47:23 [DEBUG   ] Got command BAM from MCS: ref #93948
2019-03-21 18:47:23 [INFO    ] Finished processing BAM request
2019-03-21 18:47:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93948   8 58563 67643023 A  ERROR'
2019-03-21 18:47:23 [DEBUG   ] Got command BAM from MCS: ref #93949
2019-03-21 18:47:23 [INFO    ] Finished processing BAM request
2019-03-21 18:47:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93949   8 58563 67643027 A  ERROR'
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:47:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:47:23 [DEBUG   ] spawn_process: at 2019-03-21 18:47:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:47:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 18:47:40 [DEBUG   ] Got command RPT from MCS: ref #93950
2019-03-21 18:47:40 [DEBUG   ] summary = ERROR
2019-03-21 18:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93950  13 58563 67660827 A  ERRORERROR'
2019-03-21 18:47:40 [DEBUG   ] Got command RPT from MCS: ref #93951
2019-03-21 18:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93951  77 58563 67660827 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:47:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:47:51 [DEBUG   ] Got command BAM from MCS: ref #93973
2019-03-21 18:47:51 [INFO    ] Finished processing BAM request
2019-03-21 18:47:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:47:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93973   8 58563 67671027 A  ERROR'
2019-03-21 18:47:51 [DEBUG   ] Got command BAM from MCS: ref #93974
2019-03-21 18:47:51 [INFO    ] Finished processing BAM request
2019-03-21 18:47:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:47:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93974   8 58563 67671031 A  ERROR'
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:47:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:47:51 [DEBUG   ] spawn_process: at 2019-03-21 18:47:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:48:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 18:48:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 18:48:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:48:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:48:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:48:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:48:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:48:15 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-03-21 18:48:19 [DEBUG   ] Got command BAM from MCS: ref #93975
2019-03-21 18:48:19 [INFO    ] Finished processing BAM request
2019-03-21 18:48:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93975   8 58563 67699027 A  ERROR'
2019-03-21 18:48:19 [DEBUG   ] Got command BAM from MCS: ref #93976
2019-03-21 18:48:19 [INFO    ] Finished processing BAM request
2019-03-21 18:48:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93976   8 58563 67699031 A  ERROR'
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:48:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:48:19 [DEBUG   ] spawn_process: at 2019-03-21 18:48:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:48:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 18:48:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 18:48:47 [DEBUG   ] Got command BAM from MCS: ref #93977
2019-03-21 18:48:47 [INFO    ] Finished processing BAM request
2019-03-21 18:48:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93977   8 58563 67727031 A  ERROR'
2019-03-21 18:48:47 [DEBUG   ] Got command BAM from MCS: ref #93978
2019-03-21 18:48:47 [INFO    ] Finished processing BAM request
2019-03-21 18:48:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93978   8 58563 67727035 A  ERROR'
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 18:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 18:48:47 [DEBUG   ] spawn_process: at 2019-03-21 18:48:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 18:49:05 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 18:49:15 [DEBUG   ] Got command BAM from MCS: ref #93979
2019-03-21 18:49:15 [INFO    ] Finished processing BAM request
2019-03-21 18:49:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:49:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93979   8 58563 67755023 A  ERROR'
2019-03-21 18:49:15 [DEBUG   ] Got command BAM from MCS: ref #93980
2019-03-21 18:49:15 [INFO    ] Finished processing BAM request
2019-03-21 18:49:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:49:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93980   8 58563 67755027 A  ERROR'
2019-03-21 18:49:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:49:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 18:49:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-21 18:49:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:49:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:49:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:49:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:49:15 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:49:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:49:15 [DEBUG   ] spawn_process: at 2019-03-21 18:49:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:49:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 18:49:43 [DEBUG   ] Got command BAM from MCS: ref #93982
2019-03-21 18:49:43 [INFO    ] Finished processing BAM request
2019-03-21 18:49:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:49:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93982   8 58563 67783031 A  ERROR'
2019-03-21 18:49:43 [DEBUG   ] Got command BAM from MCS: ref #93981
2019-03-21 18:49:43 [INFO    ] Finished processing BAM request
2019-03-21 18:49:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:49:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93981   8 58563 67783035 A  ERROR'
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:49:43 [DEBUG   ] spawn_process: at 2019-03-21 18:49:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:49:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 18:50:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:50:11 [DEBUG   ] Got command BAM from MCS: ref #93983
2019-03-21 18:50:11 [INFO    ] Finished processing BAM request
2019-03-21 18:50:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93983   8 58563 67811023 A  ERROR'
2019-03-21 18:50:11 [DEBUG   ] Got command BAM from MCS: ref #93984
2019-03-21 18:50:11 [INFO    ] Finished processing BAM request
2019-03-21 18:50:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93984   8 58563 67811027 A  ERROR'
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 18:50:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 18:50:11 [DEBUG   ] spawn_process: at 2019-03-21 18:50:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 18:50:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:50:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 18:50:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:50:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:50:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:50:15 [WARNING ] (13, 1, 'bot')
2019-03-21 18:50:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:50:15 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-03-21 18:50:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:50:39 [DEBUG   ] Got command BAM from MCS: ref #93985
2019-03-21 18:50:39 [INFO    ] Finished processing BAM request
2019-03-21 18:50:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93985   8 58563 67839023 A  ERROR'
2019-03-21 18:50:39 [DEBUG   ] Got command BAM from MCS: ref #93986
2019-03-21 18:50:39 [INFO    ] Finished processing BAM request
2019-03-21 18:50:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:50:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93986   8 58563 67839027 A  ERROR'
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:50:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:50:39 [DEBUG   ] spawn_process: at 2019-03-21 18:50:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:50:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:51:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:51:07 [DEBUG   ] Got command BAM from MCS: ref #93994
2019-03-21 18:51:07 [INFO    ] Finished processing BAM request
2019-03-21 18:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93994   8 58563 67867027 A  ERROR'
2019-03-21 18:51:07 [DEBUG   ] Got command BAM from MCS: ref #93993
2019-03-21 18:51:07 [INFO    ] Finished processing BAM request
2019-03-21 18:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93993   8 58563 67867031 A  ERROR'
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:51:07 [DEBUG   ] spawn_process: at 2019-03-21 18:51:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:51:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:51:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:51:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:51:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:51:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:51:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:51:16 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-03-21 18:51:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:51:35 [DEBUG   ] Got command BAM from MCS: ref #93996
2019-03-21 18:51:35 [INFO    ] Finished processing BAM request
2019-03-21 18:51:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93996   8 58563 67895031 A  ERROR'
2019-03-21 18:51:35 [DEBUG   ] Got command BAM from MCS: ref #93995
2019-03-21 18:51:35 [INFO    ] Finished processing BAM request
2019-03-21 18:51:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    93995   8 58563 67895035 A  ERROR'
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:51:35 [DEBUG   ] spawn_process: at 2019-03-21 18:51:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:51:44 [DEBUG   ] Got command RPT from MCS: ref #93997
2019-03-21 18:51:44 [DEBUG   ] summary = ERROR
2019-03-21 18:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93997  13 58563 67904083 A  ERRORERROR'
2019-03-21 18:51:44 [DEBUG   ] Got command RPT from MCS: ref #93998
2019-03-21 18:51:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93998  77 58563 67904287 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:51:44 [DEBUG   ] Got command RPT from MCS: ref #93999
2019-03-21 18:51:44 [DEBUG   ] summary = ERROR
2019-03-21 18:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    93999  13 58563 67904491 A  ERRORERROR'
2019-03-21 18:51:44 [DEBUG   ] Got command RPT from MCS: ref #94000
2019-03-21 18:51:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94000  77 58563 67904683 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:51:44 [DEBUG   ] Got command RPT from MCS: ref #94001
2019-03-21 18:51:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94001  12 58563 67904887 A  ERRORB™™š'
2019-03-21 18:51:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:52:03 [DEBUG   ] Got command BAM from MCS: ref #94003
2019-03-21 18:52:03 [INFO    ] Finished processing BAM request
2019-03-21 18:52:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:52:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94003   8 58563 67923023 A  ERROR'
2019-03-21 18:52:03 [DEBUG   ] Got command BAM from MCS: ref #94002
2019-03-21 18:52:03 [INFO    ] Finished processing BAM request
2019-03-21 18:52:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:52:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94002   8 58563 67923027 A  ERROR'
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:52:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:52:03 [DEBUG   ] spawn_process: at 2019-03-21 18:52:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:52:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:52:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:52:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:52:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:52:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:52:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:52:16 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-03-21 18:52:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:52:31 [DEBUG   ] Got command BAM from MCS: ref #94004
2019-03-21 18:52:31 [INFO    ] Finished processing BAM request
2019-03-21 18:52:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94004   8 58563 67951027 A  ERROR'
2019-03-21 18:52:31 [DEBUG   ] Got command BAM from MCS: ref #94005
2019-03-21 18:52:31 [INFO    ] Finished processing BAM request
2019-03-21 18:52:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94005   8 58563 67951031 A  ERROR'
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:52:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:52:31 [DEBUG   ] spawn_process: at 2019-03-21 18:52:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:52:40 [DEBUG   ] Got command RPT from MCS: ref #94006
2019-03-21 18:52:40 [DEBUG   ] summary = ERROR
2019-03-21 18:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94006  13 58563 67960823 A  ERRORERROR'
2019-03-21 18:52:40 [DEBUG   ] Got command RPT from MCS: ref #94007
2019-03-21 18:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94007  77 58563 67960823 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:52:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 18:52:59 [DEBUG   ] Got command BAM from MCS: ref #94024
2019-03-21 18:52:59 [INFO    ] Finished processing BAM request
2019-03-21 18:52:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:52:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94024   8 58563 67979023 A  ERROR'
2019-03-21 18:52:59 [DEBUG   ] Got command BAM from MCS: ref #94023
2019-03-21 18:52:59 [INFO    ] Finished processing BAM request
2019-03-21 18:52:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:52:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94023   8 58563 67979027 A  ERROR'
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:52:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:52:59 [DEBUG   ] spawn_process: at 2019-03-21 18:52:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:53:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:53:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:53:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:53:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:53:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:53:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:53:16 [DEBUG   ] Finished updating board flags in 1.187 seconds
2019-03-21 18:53:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 18:53:27 [DEBUG   ] Got command BAM from MCS: ref #94026
2019-03-21 18:53:27 [INFO    ] Finished processing BAM request
2019-03-21 18:53:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94026   8 58563 68007031 A  ERROR'
2019-03-21 18:53:27 [DEBUG   ] Got command BAM from MCS: ref #94025
2019-03-21 18:53:27 [INFO    ] Finished processing BAM request
2019-03-21 18:53:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94025   8 58563 68007035 A  ERROR'
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:53:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:53:27 [DEBUG   ] spawn_process: at 2019-03-21 18:53:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:53:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 18:53:55 [DEBUG   ] Got command BAM from MCS: ref #94033
2019-03-21 18:53:55 [INFO    ] Finished processing BAM request
2019-03-21 18:53:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94033   8 58563 68035031 A  ERROR'
2019-03-21 18:53:55 [DEBUG   ] Got command BAM from MCS: ref #94034
2019-03-21 18:53:55 [INFO    ] Finished processing BAM request
2019-03-21 18:53:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:53:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94034   8 58563 68035035 A  ERROR'
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:53:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:53:55 [DEBUG   ] spawn_process: at 2019-03-21 18:53:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:54:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:54:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:54:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:54:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:54:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:54:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:54:16 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-03-21 18:54:23 [DEBUG   ] Got command BAM from MCS: ref #94036
2019-03-21 18:54:23 [INFO    ] Finished processing BAM request
2019-03-21 18:54:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:54:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94036   8 58563 68063027 A  ERROR'
2019-03-21 18:54:23 [DEBUG   ] Got command BAM from MCS: ref #94035
2019-03-21 18:54:23 [INFO    ] Finished processing BAM request
2019-03-21 18:54:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:54:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94035   8 58563 68063031 A  ERROR'
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:54:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:54:23 [DEBUG   ] spawn_process: at 2019-03-21 18:54:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:54:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:54:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:54:51 [DEBUG   ] Got command BAM from MCS: ref #94037
2019-03-21 18:54:51 [INFO    ] Finished processing BAM request
2019-03-21 18:54:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94037   8 58563 68091031 A  ERROR'
2019-03-21 18:54:51 [DEBUG   ] Got command BAM from MCS: ref #94038
2019-03-21 18:54:51 [INFO    ] Finished processing BAM request
2019-03-21 18:54:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94038   8 58563 68091035 A  ERROR'
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 18:54:51 [DEBUG   ] spawn_process: at 2019-03-21 18:54:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 18:55:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:55:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:55:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:55:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:55:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:55:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:55:16 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-03-21 18:55:19 [DEBUG   ] Got command BAM from MCS: ref #94040
2019-03-21 18:55:19 [INFO    ] Finished processing BAM request
2019-03-21 18:55:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94040   8 58563 68119027 A  ERROR'
2019-03-21 18:55:19 [DEBUG   ] Got command BAM from MCS: ref #94039
2019-03-21 18:55:19 [INFO    ] Finished processing BAM request
2019-03-21 18:55:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94039   8 58563 68119031 A  ERROR'
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:55:19 [DEBUG   ] spawn_process: at 2019-03-21 18:55:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:55:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:55:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:55:47 [DEBUG   ] Got command BAM from MCS: ref #94042
2019-03-21 18:55:47 [INFO    ] Finished processing BAM request
2019-03-21 18:55:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:55:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94042   8 58563 68147027 A  ERROR'
2019-03-21 18:55:47 [DEBUG   ] Got command BAM from MCS: ref #94041
2019-03-21 18:55:47 [INFO    ] Finished processing BAM request
2019-03-21 18:55:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:55:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94041   8 58563 68147031 A  ERROR'
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:55:47 [DEBUG   ] spawn_process: at 2019-03-21 18:55:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:56:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:56:15 [DEBUG   ] Got command BAM from MCS: ref #94044
2019-03-21 18:56:15 [INFO    ] Finished processing BAM request
2019-03-21 18:56:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:56:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94044   8 58563 68175027 A  ERROR'
2019-03-21 18:56:15 [DEBUG   ] Got command BAM from MCS: ref #94043
2019-03-21 18:56:15 [INFO    ] Finished processing BAM request
2019-03-21 18:56:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:56:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94043   8 58563 68175031 A  ERROR'
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:56:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:56:15 [DEBUG   ] spawn_process: at 2019-03-21 18:56:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:56:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:56:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:56:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:56:16 [WARNING ] (13, 1, 'bot')
2019-03-21 18:56:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:56:16 [DEBUG   ] Finished updating board flags in 0.994 seconds
2019-03-21 18:56:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:56:43 [DEBUG   ] Got command BAM from MCS: ref #94048
2019-03-21 18:56:43 [INFO    ] Finished processing BAM request
2019-03-21 18:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94048   8 58563 68203023 A  ERROR'
2019-03-21 18:56:43 [DEBUG   ] Got command BAM from MCS: ref #94047
2019-03-21 18:56:43 [INFO    ] Finished processing BAM request
2019-03-21 18:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94047   8 58563 68203027 A  ERROR'
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:56:43 [DEBUG   ] spawn_process: at 2019-03-21 18:56:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:56:44 [DEBUG   ] Got command RPT from MCS: ref #94049
2019-03-21 18:56:44 [DEBUG   ] summary = ERROR
2019-03-21 18:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94049  13 58563 68204167 A  ERRORERROR'
2019-03-21 18:56:44 [DEBUG   ] Got command RPT from MCS: ref #94050
2019-03-21 18:56:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94050  77 58563 68204371 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:56:44 [DEBUG   ] Got command RPT from MCS: ref #94051
2019-03-21 18:56:44 [DEBUG   ] summary = ERROR
2019-03-21 18:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94051  13 58563 68204575 A  ERRORERROR'
2019-03-21 18:56:44 [DEBUG   ] Got command RPT from MCS: ref #94053
2019-03-21 18:56:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94053  77 58563 68204779 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:56:44 [DEBUG   ] Got command RPT from MCS: ref #94054
2019-03-21 18:56:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 18:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94054  12 58563 68204971 A  ERRORB™™š'
2019-03-21 18:56:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:57:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:57:11 [DEBUG   ] Got command BAM from MCS: ref #94066
2019-03-21 18:57:11 [INFO    ] Finished processing BAM request
2019-03-21 18:57:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:57:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94066   8 58563 68231023 A  ERROR'
2019-03-21 18:57:11 [DEBUG   ] Got command BAM from MCS: ref #94065
2019-03-21 18:57:11 [INFO    ] Finished processing BAM request
2019-03-21 18:57:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:57:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94065   8 58563 68231027 A  ERROR'
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 18:57:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 18:57:11 [DEBUG   ] spawn_process: at 2019-03-21 18:57:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 18:57:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:57:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:57:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:57:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:57:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:57:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:57:17 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-03-21 18:57:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:57:39 [DEBUG   ] Got command BAM from MCS: ref #94068
2019-03-21 18:57:39 [INFO    ] Finished processing BAM request
2019-03-21 18:57:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94068   8 58563 68259031 A  ERROR'
2019-03-21 18:57:39 [DEBUG   ] Got command BAM from MCS: ref #94067
2019-03-21 18:57:39 [INFO    ] Finished processing BAM request
2019-03-21 18:57:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94067   8 58563 68259035 A  ERROR'
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:57:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:57:39 [DEBUG   ] spawn_process: at 2019-03-21 18:57:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:57:40 [DEBUG   ] Got command RPT from MCS: ref #94069
2019-03-21 18:57:40 [DEBUG   ] summary = ERROR
2019-03-21 18:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94069  13 58563 68260835 A  ERRORERROR'
2019-03-21 18:57:40 [DEBUG   ] Got command RPT from MCS: ref #94070
2019-03-21 18:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 18:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94070  77 58563 68260835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 18:57:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:58:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 18:58:07 [DEBUG   ] Got command BAM from MCS: ref #94086
2019-03-21 18:58:07 [INFO    ] Finished processing BAM request
2019-03-21 18:58:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94086   8 58563 68287027 A  ERROR'
2019-03-21 18:58:07 [DEBUG   ] Got command BAM from MCS: ref #94087
2019-03-21 18:58:07 [INFO    ] Finished processing BAM request
2019-03-21 18:58:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94087   8 58563 68287031 A  ERROR'
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:58:07 [DEBUG   ] spawn_process: at 2019-03-21 18:58:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:58:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:58:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:58:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:58:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:58:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:58:17 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-03-21 18:58:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:58:35 [DEBUG   ] Got command BAM from MCS: ref #94088
2019-03-21 18:58:35 [INFO    ] Finished processing BAM request
2019-03-21 18:58:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94088   8 58563 68315027 A  ERROR'
2019-03-21 18:58:35 [DEBUG   ] Got command BAM from MCS: ref #94089
2019-03-21 18:58:35 [INFO    ] Finished processing BAM request
2019-03-21 18:58:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94089   8 58563 68315031 A  ERROR'
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 18:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 18:58:35 [DEBUG   ] spawn_process: at 2019-03-21 18:58:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 18:58:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:59:03 [DEBUG   ] Got command BAM from MCS: ref #94091
2019-03-21 18:59:03 [INFO    ] Finished processing BAM request
2019-03-21 18:59:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94091   8 58563 68343023 A  ERROR'
2019-03-21 18:59:03 [DEBUG   ] Got command BAM from MCS: ref #94090
2019-03-21 18:59:03 [INFO    ] Finished processing BAM request
2019-03-21 18:59:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94090   8 58563 68343027 A  ERROR'
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:59:03 [DEBUG   ] spawn_process: at 2019-03-21 18:59:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:59:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:59:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 18:59:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:59:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:59:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:59:17 [WARNING ] (13, 1, 'bot')
2019-03-21 18:59:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 18:59:17 [DEBUG   ] Finished updating board flags in 1.699 seconds
2019-03-21 18:59:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:59:31 [DEBUG   ] Got command BAM from MCS: ref #94093
2019-03-21 18:59:31 [INFO    ] Finished processing BAM request
2019-03-21 18:59:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94093   8 58563 68371027 A  ERROR'
2019-03-21 18:59:31 [DEBUG   ] Got command BAM from MCS: ref #94092
2019-03-21 18:59:31 [INFO    ] Finished processing BAM request
2019-03-21 18:59:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94092   8 58563 68371031 A  ERROR'
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:59:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:59:31 [DEBUG   ] spawn_process: at 2019-03-21 18:59:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 18:59:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 18:59:59 [DEBUG   ] Got command BAM from MCS: ref #94101
2019-03-21 18:59:59 [INFO    ] Finished processing BAM request
2019-03-21 18:59:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94101   8 58563 68399023 A  ERROR'
2019-03-21 18:59:59 [DEBUG   ] Got command BAM from MCS: ref #94100
2019-03-21 18:59:59 [INFO    ] Finished processing BAM request
2019-03-21 18:59:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 18:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94100   8 58563 68399027 A  ERROR'
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 18:59:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 18:59:59 [DEBUG   ] spawn_process: at 2019-03-21 18:59:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:00:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:00:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:00:16 [WARNING ] (13, 1, 'bot')
2019-03-21 19:00:16 [WARNING ] (13, 1, 'bot')
2019-03-21 19:00:16 [WARNING ] (13, 1, 'bot')
2019-03-21 19:00:16 [WARNING ] (13, 1, 'bot')
2019-03-21 19:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:00:16 [DEBUG   ] Finished updating board flags in 0.954 seconds
2019-03-21 19:00:26 [DEBUG   ] Got command BAM from MCS: ref #94102
2019-03-21 19:00:26 [INFO    ] Finished processing BAM request
2019-03-21 19:00:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94102   8 58563 68426027 A  ERROR'
2019-03-21 19:00:26 [DEBUG   ] Got command BAM from MCS: ref #94103
2019-03-21 19:00:26 [INFO    ] Finished processing BAM request
2019-03-21 19:00:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94103   8 58563 68426031 A  ERROR'
2019-03-21 19:00:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:00:26 [DEBUG   ] spawn_process: at 2019-03-21 19:00:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:00:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:00:53 [DEBUG   ] Got command BAM from MCS: ref #94104
2019-03-21 19:00:53 [INFO    ] Finished processing BAM request
2019-03-21 19:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94104   8 58563 68453023 A  ERROR'
2019-03-21 19:00:53 [DEBUG   ] Got command BAM from MCS: ref #94105
2019-03-21 19:00:53 [INFO    ] Finished processing BAM request
2019-03-21 19:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94105   8 58563 68453027 A  ERROR'
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:00:53 [DEBUG   ] spawn_process: at 2019-03-21 19:00:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:01:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:01:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:01:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:01:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:01:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:01:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:01:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:01:17 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-03-21 19:01:20 [DEBUG   ] Got command BAM from MCS: ref #94106
2019-03-21 19:01:20 [INFO    ] Finished processing BAM request
2019-03-21 19:01:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:01:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94106   8 58563 68480031 A  ERROR'
2019-03-21 19:01:20 [DEBUG   ] Got command BAM from MCS: ref #94107
2019-03-21 19:01:20 [INFO    ] Finished processing BAM request
2019-03-21 19:01:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:01:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94107   8 58563 68480035 A  ERROR'
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:01:20 [DEBUG   ] spawn_process: at 2019-03-21 19:01:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:01:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:01:44 [DEBUG   ] Got command RPT from MCS: ref #94108
2019-03-21 19:01:44 [DEBUG   ] summary = ERROR
2019-03-21 19:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94108  13 58563 68504255 A  ERRORERROR'
2019-03-21 19:01:44 [DEBUG   ] Got command RPT from MCS: ref #94109
2019-03-21 19:01:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94109  77 58563 68504459 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:01:44 [DEBUG   ] Got command RPT from MCS: ref #94110
2019-03-21 19:01:44 [DEBUG   ] summary = ERROR
2019-03-21 19:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94110  13 58563 68504663 A  ERRORERROR'
2019-03-21 19:01:44 [DEBUG   ] Got command RPT from MCS: ref #94111
2019-03-21 19:01:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94111  77 58563 68504855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:01:45 [DEBUG   ] Got command RPT from MCS: ref #94112
2019-03-21 19:01:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94112  12 58563 68505059 A  ERRORBš™š'
2019-03-21 19:01:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 19:01:47 [DEBUG   ] Got command BAM from MCS: ref #94113
2019-03-21 19:01:47 [INFO    ] Finished processing BAM request
2019-03-21 19:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94113   8 58563 68507027 A  ERROR'
2019-03-21 19:01:47 [DEBUG   ] Got command BAM from MCS: ref #94114
2019-03-21 19:01:47 [INFO    ] Finished processing BAM request
2019-03-21 19:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94114   8 58563 68507031 A  ERROR'
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:01:47 [DEBUG   ] spawn_process: at 2019-03-21 19:01:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:02:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:02:14 [DEBUG   ] Got command BAM from MCS: ref #94116
2019-03-21 19:02:14 [INFO    ] Finished processing BAM request
2019-03-21 19:02:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94116   8 58563 68534023 A  ERROR'
2019-03-21 19:02:14 [DEBUG   ] Got command BAM from MCS: ref #94115
2019-03-21 19:02:14 [INFO    ] Finished processing BAM request
2019-03-21 19:02:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94115   8 58563 68534027 A  ERROR'
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:02:14 [DEBUG   ] spawn_process: at 2019-03-21 19:02:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:02:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:02:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:02:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:02:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:02:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:02:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:02:17 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-03-21 19:02:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 19:02:40 [DEBUG   ] Got command RPT from MCS: ref #94119
2019-03-21 19:02:40 [DEBUG   ] summary = ERROR
2019-03-21 19:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94119  13 58563 68560831 A  ERRORERROR'
2019-03-21 19:02:40 [DEBUG   ] Got command RPT from MCS: ref #94120
2019-03-21 19:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94120  77 58563 68560831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:02:41 [DEBUG   ] Got command BAM from MCS: ref #94118
2019-03-21 19:02:41 [INFO    ] Finished processing BAM request
2019-03-21 19:02:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94118   8 58563 68561027 A  ERROR'
2019-03-21 19:02:41 [DEBUG   ] Got command BAM from MCS: ref #94117
2019-03-21 19:02:41 [INFO    ] Finished processing BAM request
2019-03-21 19:02:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94117   8 58563 68561031 A  ERROR'
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:02:41 [DEBUG   ] spawn_process: at 2019-03-21 19:02:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:02:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:03:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 19:03:08 [DEBUG   ] Got command BAM from MCS: ref #94143
2019-03-21 19:03:08 [INFO    ] Finished processing BAM request
2019-03-21 19:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94143   8 58563 68588023 A  ERROR'
2019-03-21 19:03:08 [DEBUG   ] Got command BAM from MCS: ref #94142
2019-03-21 19:03:08 [INFO    ] Finished processing BAM request
2019-03-21 19:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94142   8 58563 68588027 A  ERROR'
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:03:08 [DEBUG   ] spawn_process: at 2019-03-21 19:03:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:03:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:03:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:03:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:03:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:03:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:03:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:03:17 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-03-21 19:03:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 19:03:35 [DEBUG   ] Got command BAM from MCS: ref #94145
2019-03-21 19:03:35 [INFO    ] Finished processing BAM request
2019-03-21 19:03:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94145   8 58563 68615031 A  ERROR'
2019-03-21 19:03:35 [DEBUG   ] Got command BAM from MCS: ref #94144
2019-03-21 19:03:35 [INFO    ] Finished processing BAM request
2019-03-21 19:03:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94144   8 58563 68615035 A  ERROR'
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:03:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:03:35 [DEBUG   ] spawn_process: at 2019-03-21 19:03:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:03:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:04:02 [DEBUG   ] Got command BAM from MCS: ref #94146
2019-03-21 19:04:02 [INFO    ] Finished processing BAM request
2019-03-21 19:04:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:04:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94146   8 58563 68642027 A  ERROR'
2019-03-21 19:04:02 [DEBUG   ] Got command BAM from MCS: ref #94147
2019-03-21 19:04:02 [INFO    ] Finished processing BAM request
2019-03-21 19:04:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:04:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94147   8 58563 68642031 A  ERROR'
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:04:02 [DEBUG   ] spawn_process: at 2019-03-21 19:04:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:04:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:04:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:04:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:04:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:04:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:04:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:04:17 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-03-21 19:04:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:04:29 [DEBUG   ] Got command BAM from MCS: ref #94148
2019-03-21 19:04:29 [INFO    ] Finished processing BAM request
2019-03-21 19:04:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94148   8 58563 68669023 A  ERROR'
2019-03-21 19:04:29 [DEBUG   ] Got command BAM from MCS: ref #94149
2019-03-21 19:04:29 [INFO    ] Finished processing BAM request
2019-03-21 19:04:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94149   8 58563 68669027 A  ERROR'
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:04:29 [DEBUG   ] spawn_process: at 2019-03-21 19:04:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:04:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:04:56 [DEBUG   ] Got command BAM from MCS: ref #94150
2019-03-21 19:04:56 [INFO    ] Finished processing BAM request
2019-03-21 19:04:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94150   8 58563 68696023 A  ERROR'
2019-03-21 19:04:56 [DEBUG   ] Got command BAM from MCS: ref #94151
2019-03-21 19:04:56 [INFO    ] Finished processing BAM request
2019-03-21 19:04:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94151   8 58563 68696027 A  ERROR'
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:04:56 [DEBUG   ] spawn_process: at 2019-03-21 19:04:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:05:06 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2019-03-21 19:05:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 19:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:05:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:05:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:05:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:05:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:05:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:05:17 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-03-21 19:05:23 [DEBUG   ] Got command BAM from MCS: ref #94153
2019-03-21 19:05:23 [INFO    ] Finished processing BAM request
2019-03-21 19:05:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94153   8 58563 68723023 A  ERROR'
2019-03-21 19:05:23 [DEBUG   ] Got command BAM from MCS: ref #94152
2019-03-21 19:05:23 [INFO    ] Finished processing BAM request
2019-03-21 19:05:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94152   8 58563 68723027 A  ERROR'
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:05:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:05:23 [DEBUG   ] spawn_process: at 2019-03-21 19:05:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:05:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 19:05:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:05:50 [DEBUG   ] Got command BAM from MCS: ref #94161
2019-03-21 19:05:50 [INFO    ] Finished processing BAM request
2019-03-21 19:05:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:05:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94161   8 58563 68750031 A  ERROR'
2019-03-21 19:05:50 [DEBUG   ] Got command BAM from MCS: ref #94160
2019-03-21 19:05:50 [INFO    ] Finished processing BAM request
2019-03-21 19:05:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:05:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94160   8 58563 68750035 A  ERROR'
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:05:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:05:50 [DEBUG   ] spawn_process: at 2019-03-21 19:05:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:06:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 19:06:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:06:17 [DEBUG   ] Got command BAM from MCS: ref #94162
2019-03-21 19:06:17 [INFO    ] Finished processing BAM request
2019-03-21 19:06:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94162   8 58563 68777023 A  ERROR'
2019-03-21 19:06:17 [DEBUG   ] Got command BAM from MCS: ref #94163
2019-03-21 19:06:17 [INFO    ] Finished processing BAM request
2019-03-21 19:06:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94163   8 58563 68777027 A  ERROR'
2019-03-21 19:06:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:06:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:06:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:06:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:06:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:06:17 [DEBUG   ] Finished updating board flags in 0.984 seconds
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:06:17 [DEBUG   ] spawn_process: at 2019-03-21 19:06:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:06:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:06:44 [DEBUG   ] Got command BAM from MCS: ref #94167
2019-03-21 19:06:44 [INFO    ] Finished processing BAM request
2019-03-21 19:06:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94167   8 58563 68804023 A  ERROR'
2019-03-21 19:06:44 [DEBUG   ] Got command BAM from MCS: ref #94166
2019-03-21 19:06:44 [INFO    ] Finished processing BAM request
2019-03-21 19:06:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94166   8 58563 68804027 A  ERROR'
2019-03-21 19:06:44 [DEBUG   ] Got command RPT from MCS: ref #94168
2019-03-21 19:06:44 [DEBUG   ] summary = ERROR
2019-03-21 19:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94168  13 58563 68804339 A  ERRORERROR'
2019-03-21 19:06:44 [DEBUG   ] Got command RPT from MCS: ref #94169
2019-03-21 19:06:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94169  77 58563 68804543 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:06:44 [DEBUG   ] Got command RPT from MCS: ref #94170
2019-03-21 19:06:44 [DEBUG   ] summary = ERROR
2019-03-21 19:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94170  13 58563 68804747 A  ERRORERROR'
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:06:44 [DEBUG   ] Got command RPT from MCS: ref #94172
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:06:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94172  77 58563 68804951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:06:44 [DEBUG   ] spawn_process: at 2019-03-21 19:06:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:06:45 [DEBUG   ] Got command RPT from MCS: ref #94173
2019-03-21 19:06:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94173  12 58563 68805143 A  ERRORBš™š'
2019-03-21 19:06:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 19:07:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:07:11 [DEBUG   ] Got command BAM from MCS: ref #94178
2019-03-21 19:07:11 [INFO    ] Finished processing BAM request
2019-03-21 19:07:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94178   8 58563 68831027 A  ERROR'
2019-03-21 19:07:11 [DEBUG   ] Got command BAM from MCS: ref #94179
2019-03-21 19:07:11 [INFO    ] Finished processing BAM request
2019-03-21 19:07:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94179   8 58563 68831031 A  ERROR'
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:07:11 [DEBUG   ] spawn_process: at 2019-03-21 19:07:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:07:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:07:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:07:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:07:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:07:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:07:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:07:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:07:17 [DEBUG   ] Finished updating board flags in 1.271 seconds
2019-03-21 19:07:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:07:38 [DEBUG   ] Got command BAM from MCS: ref #94180
2019-03-21 19:07:38 [INFO    ] Finished processing BAM request
2019-03-21 19:07:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94180   8 58563 68858027 A  ERROR'
2019-03-21 19:07:38 [DEBUG   ] Got command BAM from MCS: ref #94181
2019-03-21 19:07:38 [INFO    ] Finished processing BAM request
2019-03-21 19:07:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94181   8 58563 68858031 A  ERROR'
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:07:38 [DEBUG   ] spawn_process: at 2019-03-21 19:07:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:07:40 [DEBUG   ] Got command RPT from MCS: ref #94182
2019-03-21 19:07:40 [DEBUG   ] summary = ERROR
2019-03-21 19:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94182  13 58563 68860827 A  ERRORERROR'
2019-03-21 19:07:40 [DEBUG   ] Got command RPT from MCS: ref #94183
2019-03-21 19:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94183  77 58563 68860827 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:07:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:08:05 [DEBUG   ] Got command BAM from MCS: ref #94199
2019-03-21 19:08:05 [INFO    ] Finished processing BAM request
2019-03-21 19:08:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94199   8 58563 68885023 A  ERROR'
2019-03-21 19:08:05 [DEBUG   ] Got command BAM from MCS: ref #94200
2019-03-21 19:08:05 [INFO    ] Finished processing BAM request
2019-03-21 19:08:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94200   8 58563 68885027 A  ERROR'
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:08:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:08:05 [DEBUG   ] spawn_process: at 2019-03-21 19:08:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:08:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:08:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:08:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:08:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:08:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:08:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:08:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:08:18 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-03-21 19:08:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 19:08:32 [DEBUG   ] Got command BAM from MCS: ref #94202
2019-03-21 19:08:32 [INFO    ] Finished processing BAM request
2019-03-21 19:08:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94202   8 58563 68912031 A  ERROR'
2019-03-21 19:08:32 [DEBUG   ] Got command BAM from MCS: ref #94201
2019-03-21 19:08:32 [INFO    ] Finished processing BAM request
2019-03-21 19:08:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94201   8 58563 68912035 A  ERROR'
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:08:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:08:32 [DEBUG   ] spawn_process: at 2019-03-21 19:08:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:08:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:08:59 [DEBUG   ] Got command BAM from MCS: ref #94209
2019-03-21 19:08:59 [INFO    ] Finished processing BAM request
2019-03-21 19:08:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94209   8 58563 68939031 A  ERROR'
2019-03-21 19:08:59 [DEBUG   ] Got command BAM from MCS: ref #94210
2019-03-21 19:08:59 [INFO    ] Finished processing BAM request
2019-03-21 19:08:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94210   8 58563 68939035 A  ERROR'
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:08:59 [DEBUG   ] spawn_process: at 2019-03-21 19:08:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:09:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:09:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:09:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:09:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:09:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:09:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:09:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:09:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:09:17 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-03-21 19:09:26 [DEBUG   ] Got command BAM from MCS: ref #94211
2019-03-21 19:09:26 [INFO    ] Finished processing BAM request
2019-03-21 19:09:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94211   8 58563 68966027 A  ERROR'
2019-03-21 19:09:26 [DEBUG   ] Got command BAM from MCS: ref #94212
2019-03-21 19:09:26 [INFO    ] Finished processing BAM request
2019-03-21 19:09:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94212   8 58563 68966031 A  ERROR'
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:09:26 [DEBUG   ] spawn_process: at 2019-03-21 19:09:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:09:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:09:47 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 19:09:53 [DEBUG   ] Got command BAM from MCS: ref #94214
2019-03-21 19:09:53 [INFO    ] Finished processing BAM request
2019-03-21 19:09:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94214   8 58563 68993027 A  ERROR'
2019-03-21 19:09:53 [DEBUG   ] Got command BAM from MCS: ref #94213
2019-03-21 19:09:53 [INFO    ] Finished processing BAM request
2019-03-21 19:09:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94213   8 58563 68993031 A  ERROR'
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:09:53 [DEBUG   ] spawn_process: at 2019-03-21 19:09:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:10:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:10:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:10:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:10:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:10:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:10:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:10:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:10:18 [DEBUG   ] Finished updating board flags in 1.692 seconds
2019-03-21 19:10:20 [DEBUG   ] Got command BAM from MCS: ref #94216
2019-03-21 19:10:20 [INFO    ] Finished processing BAM request
2019-03-21 19:10:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94216   8 58563 69020023 A  ERROR'
2019-03-21 19:10:20 [DEBUG   ] Got command BAM from MCS: ref #94215
2019-03-21 19:10:20 [INFO    ] Finished processing BAM request
2019-03-21 19:10:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94215   8 58563 69020027 A  ERROR'
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:10:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:10:20 [DEBUG   ] spawn_process: at 2019-03-21 19:10:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:10:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:10:47 [DEBUG   ] Got command BAM from MCS: ref #94217
2019-03-21 19:10:47 [INFO    ] Finished processing BAM request
2019-03-21 19:10:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:10:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94217   8 58563 69047031 A  ERROR'
2019-03-21 19:10:47 [DEBUG   ] Got command BAM from MCS: ref #94218
2019-03-21 19:10:47 [INFO    ] Finished processing BAM request
2019-03-21 19:10:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:10:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94218   8 58563 69047035 A  ERROR'
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:10:47 [DEBUG   ] spawn_process: at 2019-03-21 19:10:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:10:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 19:11:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:11:14 [DEBUG   ] Got command BAM from MCS: ref #94220
2019-03-21 19:11:14 [INFO    ] Finished processing BAM request
2019-03-21 19:11:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94220   8 58563 69074031 A  ERROR'
2019-03-21 19:11:14 [DEBUG   ] Got command BAM from MCS: ref #94219
2019-03-21 19:11:14 [INFO    ] Finished processing BAM request
2019-03-21 19:11:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94219   8 58563 69074035 A  ERROR'
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:11:14 [DEBUG   ] spawn_process: at 2019-03-21 19:11:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:11:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:11:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:11:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:11:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:11:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:11:17 [WARNING ] (13, 1, 'bot')
2019-03-21 19:11:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:11:17 [DEBUG   ] Finished updating board flags in 0.897 seconds
2019-03-21 19:11:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:11:41 [DEBUG   ] Got command BAM from MCS: ref #94221
2019-03-21 19:11:41 [INFO    ] Finished processing BAM request
2019-03-21 19:11:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94221   8 58563 69101023 A  ERROR'
2019-03-21 19:11:41 [DEBUG   ] Got command BAM from MCS: ref #94222
2019-03-21 19:11:41 [INFO    ] Finished processing BAM request
2019-03-21 19:11:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94222   8 58563 69101027 A  ERROR'
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:11:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:11:41 [DEBUG   ] spawn_process: at 2019-03-21 19:11:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:11:44 [DEBUG   ] Got command RPT from MCS: ref #94223
2019-03-21 19:11:44 [DEBUG   ] summary = ERROR
2019-03-21 19:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94223  13 58563 69104427 A  ERRORERROR'
2019-03-21 19:11:44 [DEBUG   ] Got command RPT from MCS: ref #94224
2019-03-21 19:11:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94224  77 58563 69104631 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:11:44 [DEBUG   ] Got command RPT from MCS: ref #94225
2019-03-21 19:11:44 [DEBUG   ] summary = ERROR
2019-03-21 19:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94225  13 58563 69104835 A  ERRORERROR'
2019-03-21 19:11:45 [DEBUG   ] Got command RPT from MCS: ref #94226
2019-03-21 19:11:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94226  77 58563 69105027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:11:45 [DEBUG   ] Got command RPT from MCS: ref #94227
2019-03-21 19:11:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94227  12 58563 69105231 A  ERRORBš™š'
2019-03-21 19:11:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:12:08 [DEBUG   ] Got command BAM from MCS: ref #94235
2019-03-21 19:12:08 [INFO    ] Finished processing BAM request
2019-03-21 19:12:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:12:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94235   8 58563 69128027 A  ERROR'
2019-03-21 19:12:08 [DEBUG   ] Got command BAM from MCS: ref #94234
2019-03-21 19:12:08 [INFO    ] Finished processing BAM request
2019-03-21 19:12:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:12:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94234   8 58563 69128031 A  ERROR'
2019-03-21 19:12:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:12:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:12:08 [DEBUG   ] spawn_process: at 2019-03-21 19:12:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:12:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:12:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:12:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:12:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:12:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:12:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:12:18 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-03-21 19:12:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:12:35 [DEBUG   ] Got command BAM from MCS: ref #94236
2019-03-21 19:12:35 [INFO    ] Finished processing BAM request
2019-03-21 19:12:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94236   8 58563 69155031 A  ERROR'
2019-03-21 19:12:35 [DEBUG   ] Got command BAM from MCS: ref #94237
2019-03-21 19:12:35 [INFO    ] Finished processing BAM request
2019-03-21 19:12:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94237   8 58563 69155035 A  ERROR'
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:12:35 [DEBUG   ] spawn_process: at 2019-03-21 19:12:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:12:40 [DEBUG   ] Got command RPT from MCS: ref #94238
2019-03-21 19:12:40 [DEBUG   ] summary = ERROR
2019-03-21 19:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94238  13 58563 69160831 A  ERRORERROR'
2019-03-21 19:12:40 [DEBUG   ] Got command RPT from MCS: ref #94239
2019-03-21 19:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94239  77 58563 69160831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:12:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:13:02 [DEBUG   ] Got command BAM from MCS: ref #94256
2019-03-21 19:13:02 [INFO    ] Finished processing BAM request
2019-03-21 19:13:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94256   8 58563 69182023 A  ERROR'
2019-03-21 19:13:02 [DEBUG   ] Got command BAM from MCS: ref #94255
2019-03-21 19:13:02 [INFO    ] Finished processing BAM request
2019-03-21 19:13:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94255   8 58563 69182027 A  ERROR'
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:13:02 [DEBUG   ] spawn_process: at 2019-03-21 19:13:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:13:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 19:13:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:13:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:13:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:13:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:13:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:13:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:13:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:13:18 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-03-21 19:13:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:13:29 [DEBUG   ] Got command BAM from MCS: ref #94258
2019-03-21 19:13:29 [INFO    ] Finished processing BAM request
2019-03-21 19:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94258   8 58563 69209023 A  ERROR'
2019-03-21 19:13:29 [DEBUG   ] Got command BAM from MCS: ref #94257
2019-03-21 19:13:29 [INFO    ] Finished processing BAM request
2019-03-21 19:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94257   8 58563 69209027 A  ERROR'
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:13:29 [DEBUG   ] spawn_process: at 2019-03-21 19:13:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:13:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:13:56 [DEBUG   ] Got command BAM from MCS: ref #94259
2019-03-21 19:13:56 [INFO    ] Finished processing BAM request
2019-03-21 19:13:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94259   8 58563 69236023 A  ERROR'
2019-03-21 19:13:56 [DEBUG   ] Got command BAM from MCS: ref #94260
2019-03-21 19:13:56 [INFO    ] Finished processing BAM request
2019-03-21 19:13:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94260   8 58563 69236027 A  ERROR'
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:13:56 [DEBUG   ] spawn_process: at 2019-03-21 19:13:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:14:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:14:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:14:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:14:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:14:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:14:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:14:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:14:18 [DEBUG   ] Finished updating board flags in 1.171 seconds
2019-03-21 19:14:23 [DEBUG   ] Got command BAM from MCS: ref #94262
2019-03-21 19:14:23 [INFO    ] Finished processing BAM request
2019-03-21 19:14:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:14:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94262   8 58563 69263023 A  ERROR'
2019-03-21 19:14:23 [DEBUG   ] Got command BAM from MCS: ref #94261
2019-03-21 19:14:23 [INFO    ] Finished processing BAM request
2019-03-21 19:14:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:14:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94261   8 58563 69263027 A  ERROR'
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:14:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:14:23 [DEBUG   ] spawn_process: at 2019-03-21 19:14:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:14:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 19:14:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 19:14:50 [DEBUG   ] Got command BAM from MCS: ref #94269
2019-03-21 19:14:50 [INFO    ] Finished processing BAM request
2019-03-21 19:14:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94269   8 58563 69290023 A  ERROR'
2019-03-21 19:14:50 [DEBUG   ] Got command BAM from MCS: ref #94270
2019-03-21 19:14:50 [INFO    ] Finished processing BAM request
2019-03-21 19:14:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94270   8 58563 69290027 A  ERROR'
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:14:50 [DEBUG   ] spawn_process: at 2019-03-21 19:14:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:15:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 19:15:17 [DEBUG   ] Got command BAM from MCS: ref #94271
2019-03-21 19:15:17 [INFO    ] Finished processing BAM request
2019-03-21 19:15:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94271   8 58563 69317027 A  ERROR'
2019-03-21 19:15:17 [DEBUG   ] Got command BAM from MCS: ref #94272
2019-03-21 19:15:17 [INFO    ] Finished processing BAM request
2019-03-21 19:15:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94272   8 58563 69317031 A  ERROR'
2019-03-21 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:15:17 [DEBUG   ] spawn_process: at 2019-03-21 19:15:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:15:18 [DEBUG   ] spawn_process: at 2019-03-21 19:15:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:15:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:15:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:15:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:15:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:15:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:15:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:15:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:15:19 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-03-21 19:15:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 19:15:44 [DEBUG   ] Got command BAM from MCS: ref #94274
2019-03-21 19:15:44 [INFO    ] Finished processing BAM request
2019-03-21 19:15:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94274   8 58563 69344031 A  ERROR'
2019-03-21 19:15:44 [DEBUG   ] Got command BAM from MCS: ref #94273
2019-03-21 19:15:44 [INFO    ] Finished processing BAM request
2019-03-21 19:15:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94273   8 58563 69344035 A  ERROR'
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:15:44 [DEBUG   ] spawn_process: at 2019-03-21 19:15:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:15:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:16:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:16:11 [DEBUG   ] Got command BAM from MCS: ref #94276
2019-03-21 19:16:11 [INFO    ] Finished processing BAM request
2019-03-21 19:16:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94276   8 58563 69371027 A  ERROR'
2019-03-21 19:16:11 [DEBUG   ] Got command BAM from MCS: ref #94275
2019-03-21 19:16:11 [INFO    ] Finished processing BAM request
2019-03-21 19:16:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94275   8 58563 69371031 A  ERROR'
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:16:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:16:11 [DEBUG   ] spawn_process: at 2019-03-21 19:16:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:16:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:16:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:16:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:16:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:16:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:16:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:16:19 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-03-21 19:16:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:16:38 [DEBUG   ] Got command BAM from MCS: ref #94278
2019-03-21 19:16:38 [INFO    ] Finished processing BAM request
2019-03-21 19:16:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94278   8 58563 69398027 A  ERROR'
2019-03-21 19:16:38 [DEBUG   ] Got command BAM from MCS: ref #94277
2019-03-21 19:16:38 [INFO    ] Finished processing BAM request
2019-03-21 19:16:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94277   8 58563 69398031 A  ERROR'
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:16:38 [DEBUG   ] spawn_process: at 2019-03-21 19:16:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:16:44 [DEBUG   ] Got command RPT from MCS: ref #94281
2019-03-21 19:16:44 [DEBUG   ] summary = ERROR
2019-03-21 19:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94281  13 58563 69404511 A  ERRORERROR'
2019-03-21 19:16:44 [DEBUG   ] Got command RPT from MCS: ref #94282
2019-03-21 19:16:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94282  77 58563 69404715 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:16:44 [DEBUG   ] Got command RPT from MCS: ref #94283
2019-03-21 19:16:44 [DEBUG   ] summary = ERROR
2019-03-21 19:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94283  13 58563 69404911 A  ERRORERROR'
2019-03-21 19:16:45 [DEBUG   ] Got command RPT from MCS: ref #94285
2019-03-21 19:16:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94285  77 58563 69405115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:16:45 [DEBUG   ] Got command RPT from MCS: ref #94287
2019-03-21 19:16:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94287  12 58563 69405319 A  ERRORB™™š'
2019-03-21 19:16:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:17:05 [DEBUG   ] Got command BAM from MCS: ref #94291
2019-03-21 19:17:05 [INFO    ] Finished processing BAM request
2019-03-21 19:17:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94291   8 58563 69425023 A  ERROR'
2019-03-21 19:17:05 [DEBUG   ] Got command BAM from MCS: ref #94292
2019-03-21 19:17:05 [INFO    ] Finished processing BAM request
2019-03-21 19:17:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94292   8 58563 69425027 A  ERROR'
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:17:05 [DEBUG   ] spawn_process: at 2019-03-21 19:17:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:17:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:17:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:17:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:17:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:17:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:17:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:17:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:17:19 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-03-21 19:17:28 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 19:17:32 [DEBUG   ] Got command BAM from MCS: ref #94294
2019-03-21 19:17:32 [INFO    ] Finished processing BAM request
2019-03-21 19:17:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94294   8 58563 69452027 A  ERROR'
2019-03-21 19:17:32 [DEBUG   ] Got command BAM from MCS: ref #94293
2019-03-21 19:17:32 [INFO    ] Finished processing BAM request
2019-03-21 19:17:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94293   8 58563 69452031 A  ERROR'
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:17:32 [DEBUG   ] spawn_process: at 2019-03-21 19:17:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:17:40 [DEBUG   ] Got command RPT from MCS: ref #94295
2019-03-21 19:17:40 [DEBUG   ] summary = ERROR
2019-03-21 19:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94295  13 58563 69460839 A  ERRORERROR'
2019-03-21 19:17:40 [DEBUG   ] Got command RPT from MCS: ref #94296
2019-03-21 19:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94296  77 58563 69460839 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:17:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:17:59 [DEBUG   ] Got command BAM from MCS: ref #94318
2019-03-21 19:17:59 [INFO    ] Finished processing BAM request
2019-03-21 19:17:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:17:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94318   8 58563 69479031 A  ERROR'
2019-03-21 19:17:59 [DEBUG   ] Got command BAM from MCS: ref #94319
2019-03-21 19:17:59 [INFO    ] Finished processing BAM request
2019-03-21 19:17:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:17:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94319   8 58563 69479035 A  ERROR'
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:17:59 [DEBUG   ] spawn_process: at 2019-03-21 19:17:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:18:08 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 19:18:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:18:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:18:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:18:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:18:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:18:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:18:19 [DEBUG   ] Finished updating board flags in 1.833 seconds
2019-03-21 19:18:26 [DEBUG   ] Got command BAM from MCS: ref #94321
2019-03-21 19:18:26 [INFO    ] Finished processing BAM request
2019-03-21 19:18:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94321   8 58563 69506031 A  ERROR'
2019-03-21 19:18:26 [DEBUG   ] Got command BAM from MCS: ref #94320
2019-03-21 19:18:26 [INFO    ] Finished processing BAM request
2019-03-21 19:18:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94320   8 58563 69506035 A  ERROR'
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:18:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:18:26 [DEBUG   ] spawn_process: at 2019-03-21 19:18:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:18:28 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 19:18:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 19:18:53 [DEBUG   ] Got command BAM from MCS: ref #94323
2019-03-21 19:18:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:18:53 [INFO    ] Finished processing BAM request
2019-03-21 19:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94323   8 58563 69533031 A  ERROR'
2019-03-21 19:18:53 [DEBUG   ] Got command BAM from MCS: ref #94322
2019-03-21 19:18:53 [INFO    ] Finished processing BAM request
2019-03-21 19:18:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94322   8 58563 69533039 A  ERROR'
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:18:53 [DEBUG   ] spawn_process: at 2019-03-21 19:18:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:19:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:19:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:19:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:19:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:19:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:19:18 [WARNING ] (13, 1, 'bot')
2019-03-21 19:19:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:19:18 [DEBUG   ] Finished updating board flags in 1.190 seconds
2019-03-21 19:19:20 [DEBUG   ] Got command BAM from MCS: ref #94325
2019-03-21 19:19:20 [INFO    ] Finished processing BAM request
2019-03-21 19:19:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94325   8 58563 69560023 A  ERROR'
2019-03-21 19:19:20 [DEBUG   ] Got command BAM from MCS: ref #94324
2019-03-21 19:19:20 [INFO    ] Finished processing BAM request
2019-03-21 19:19:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94324   8 58563 69560027 A  ERROR'
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:19:20 [DEBUG   ] spawn_process: at 2019-03-21 19:19:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:19:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:19:47 [DEBUG   ] Got command BAM from MCS: ref #94326
2019-03-21 19:19:47 [INFO    ] Finished processing BAM request
2019-03-21 19:19:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94326   8 58563 69587031 A  ERROR'
2019-03-21 19:19:47 [DEBUG   ] Got command BAM from MCS: ref #94327
2019-03-21 19:19:47 [INFO    ] Finished processing BAM request
2019-03-21 19:19:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94327   8 58563 69587035 A  ERROR'
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:19:47 [DEBUG   ] spawn_process: at 2019-03-21 19:19:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:19:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:20:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:20:14 [DEBUG   ] Got command BAM from MCS: ref #94328
2019-03-21 19:20:14 [INFO    ] Finished processing BAM request
2019-03-21 19:20:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94328   8 58563 69614031 A  ERROR'
2019-03-21 19:20:14 [DEBUG   ] Got command BAM from MCS: ref #94329
2019-03-21 19:20:14 [INFO    ] Finished processing BAM request
2019-03-21 19:20:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94329   8 58563 69614035 A  ERROR'
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:20:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:20:14 [DEBUG   ] spawn_process: at 2019-03-21 19:20:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:20:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:20:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:20:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:20:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:20:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:20:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:20:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:20:19 [DEBUG   ] Finished updating board flags in 1.563 seconds
2019-03-21 19:20:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 19:20:41 [DEBUG   ] Got command BAM from MCS: ref #94331
2019-03-21 19:20:41 [INFO    ] Finished processing BAM request
2019-03-21 19:20:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:20:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94331   8 58563 69641031 A  ERROR'
2019-03-21 19:20:41 [DEBUG   ] Got command BAM from MCS: ref #94330
2019-03-21 19:20:41 [INFO    ] Finished processing BAM request
2019-03-21 19:20:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:20:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94330   8 58563 69641035 A  ERROR'
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:20:41 [DEBUG   ] spawn_process: at 2019-03-21 19:20:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:20:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 19:21:08 [DEBUG   ] Got command BAM from MCS: ref #94338
2019-03-21 19:21:08 [INFO    ] Finished processing BAM request
2019-03-21 19:21:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94338   8 58563 69668023 A  ERROR'
2019-03-21 19:21:08 [DEBUG   ] Got command BAM from MCS: ref #94339
2019-03-21 19:21:08 [INFO    ] Finished processing BAM request
2019-03-21 19:21:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:21:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94339   8 58563 69668027 A  ERROR'
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:21:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:21:08 [DEBUG   ] spawn_process: at 2019-03-21 19:21:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:21:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:21:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:21:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:21:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:21:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:21:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:21:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:21:19 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-03-21 19:21:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:21:35 [DEBUG   ] Got command BAM from MCS: ref #94341
2019-03-21 19:21:35 [INFO    ] Finished processing BAM request
2019-03-21 19:21:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94341   8 58563 69695027 A  ERROR'
2019-03-21 19:21:35 [DEBUG   ] Got command BAM from MCS: ref #94340
2019-03-21 19:21:35 [INFO    ] Finished processing BAM request
2019-03-21 19:21:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94340   8 58563 69695031 A  ERROR'
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:21:35 [DEBUG   ] spawn_process: at 2019-03-21 19:21:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:21:44 [DEBUG   ] Got command RPT from MCS: ref #94342
2019-03-21 19:21:44 [DEBUG   ] summary = ERROR
2019-03-21 19:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94342  13 58563 69704595 A  ERRORERROR'
2019-03-21 19:21:44 [DEBUG   ] Got command RPT from MCS: ref #94343
2019-03-21 19:21:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94343  77 58563 69704799 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:21:45 [DEBUG   ] Got command RPT from MCS: ref #94344
2019-03-21 19:21:45 [DEBUG   ] summary = ERROR
2019-03-21 19:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94344  13 58563 69705003 A  ERRORERROR'
2019-03-21 19:21:45 [DEBUG   ] Got command RPT from MCS: ref #94345
2019-03-21 19:21:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94345  77 58563 69705207 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:21:45 [DEBUG   ] Got command RPT from MCS: ref #94346
2019-03-21 19:21:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94346  12 58563 69705399 A  ERRORBš™š'
2019-03-21 19:21:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:22:02 [DEBUG   ] Got command BAM from MCS: ref #94348
2019-03-21 19:22:02 [INFO    ] Finished processing BAM request
2019-03-21 19:22:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94348   8 58563 69722023 A  ERROR'
2019-03-21 19:22:02 [DEBUG   ] Got command BAM from MCS: ref #94347
2019-03-21 19:22:02 [INFO    ] Finished processing BAM request
2019-03-21 19:22:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94347   8 58563 69722027 A  ERROR'
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:22:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:22:02 [DEBUG   ] spawn_process: at 2019-03-21 19:22:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:22:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:22:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 19:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:22:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:22:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:22:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:22:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:22:19 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-03-21 19:22:29 [DEBUG   ] Got command BAM from MCS: ref #94349
2019-03-21 19:22:29 [INFO    ] Finished processing BAM request
2019-03-21 19:22:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94349   8 58563 69749027 A  ERROR'
2019-03-21 19:22:29 [DEBUG   ] Got command BAM from MCS: ref #94350
2019-03-21 19:22:29 [INFO    ] Finished processing BAM request
2019-03-21 19:22:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94350   8 58563 69749031 A  ERROR'
2019-03-21 19:22:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:22:29 [DEBUG   ] spawn_process: at 2019-03-21 19:22:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:22:40 [DEBUG   ] Got command RPT from MCS: ref #94351
2019-03-21 19:22:40 [DEBUG   ] summary = ERROR
2019-03-21 19:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94351  13 58563 69760835 A  ERRORERROR'
2019-03-21 19:22:40 [DEBUG   ] Got command RPT from MCS: ref #94352
2019-03-21 19:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94352  77 58563 69760835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:22:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:22:56 [DEBUG   ] Got command BAM from MCS: ref #94368
2019-03-21 19:22:56 [INFO    ] Finished processing BAM request
2019-03-21 19:22:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:22:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94368   8 58563 69776031 A  ERROR'
2019-03-21 19:22:56 [DEBUG   ] Got command BAM from MCS: ref #94369
2019-03-21 19:22:56 [INFO    ] Finished processing BAM request
2019-03-21 19:22:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:22:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94369   8 58563 69776035 A  ERROR'
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:22:56 [DEBUG   ] spawn_process: at 2019-03-21 19:22:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:23:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:23:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:23:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:23:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:23:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:23:19 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-03-21 19:23:23 [DEBUG   ] Got command BAM from MCS: ref #94371
2019-03-21 19:23:23 [INFO    ] Finished processing BAM request
2019-03-21 19:23:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94371   8 58563 69803031 A  ERROR'
2019-03-21 19:23:23 [DEBUG   ] Got command BAM from MCS: ref #94370
2019-03-21 19:23:23 [INFO    ] Finished processing BAM request
2019-03-21 19:23:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94370   8 58563 69803035 A  ERROR'
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:23:23 [DEBUG   ] spawn_process: at 2019-03-21 19:23:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:23:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 19:23:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 19:23:50 [DEBUG   ] Got command BAM from MCS: ref #94379
2019-03-21 19:23:50 [INFO    ] Finished processing BAM request
2019-03-21 19:23:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94379   8 58563 69830023 A  ERROR'
2019-03-21 19:23:50 [DEBUG   ] Got command BAM from MCS: ref #94378
2019-03-21 19:23:50 [INFO    ] Finished processing BAM request
2019-03-21 19:23:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94378   8 58563 69830027 A  ERROR'
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:23:50 [DEBUG   ] spawn_process: at 2019-03-21 19:23:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:24:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:24:17 [DEBUG   ] Got command BAM from MCS: ref #94381
2019-03-21 19:24:17 [INFO    ] Finished processing BAM request
2019-03-21 19:24:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94381   8 58563 69857023 A  ERROR'
2019-03-21 19:24:17 [DEBUG   ] Got command BAM from MCS: ref #94380
2019-03-21 19:24:17 [INFO    ] Finished processing BAM request
2019-03-21 19:24:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94380   8 58563 69857027 A  ERROR'
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:24:17 [DEBUG   ] spawn_process: at 2019-03-21 19:24:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:24:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:24:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:24:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:24:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:24:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:24:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:24:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:24:19 [DEBUG   ] Finished updating board flags in 1.349 seconds
2019-03-21 19:24:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:24:44 [DEBUG   ] Got command BAM from MCS: ref #94382
2019-03-21 19:24:44 [INFO    ] Finished processing BAM request
2019-03-21 19:24:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:24:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94382   8 58563 69884027 A  ERROR'
2019-03-21 19:24:44 [DEBUG   ] Got command BAM from MCS: ref #94383
2019-03-21 19:24:44 [INFO    ] Finished processing BAM request
2019-03-21 19:24:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:24:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94383   8 58563 69884031 A  ERROR'
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:24:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:24:44 [DEBUG   ] spawn_process: at 2019-03-21 19:24:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:24:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:25:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:25:11 [DEBUG   ] Got command BAM from MCS: ref #94385
2019-03-21 19:25:11 [INFO    ] Finished processing BAM request
2019-03-21 19:25:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94385   8 58563 69911031 A  ERROR'
2019-03-21 19:25:11 [DEBUG   ] Got command BAM from MCS: ref #94384
2019-03-21 19:25:11 [INFO    ] Finished processing BAM request
2019-03-21 19:25:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94384   8 58563 69911035 A  ERROR'
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:25:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:25:11 [DEBUG   ] spawn_process: at 2019-03-21 19:25:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:25:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:25:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:25:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:25:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:25:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:25:19 [DEBUG   ] Finished updating board flags in 1.200 seconds
2019-03-21 19:25:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:25:38 [DEBUG   ] Got command BAM from MCS: ref #94386
2019-03-21 19:25:38 [INFO    ] Finished processing BAM request
2019-03-21 19:25:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:25:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94386   8 58563 69938031 A  ERROR'
2019-03-21 19:25:38 [DEBUG   ] Got command BAM from MCS: ref #94387
2019-03-21 19:25:38 [INFO    ] Finished processing BAM request
2019-03-21 19:25:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:25:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94387   8 58563 69938035 A  ERROR'
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:25:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:25:38 [DEBUG   ] spawn_process: at 2019-03-21 19:25:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:25:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:26:05 [DEBUG   ] Got command BAM from MCS: ref #94389
2019-03-21 19:26:05 [INFO    ] Finished processing BAM request
2019-03-21 19:26:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94389   8 58563 69965031 A  ERROR'
2019-03-21 19:26:05 [DEBUG   ] Got command BAM from MCS: ref #94388
2019-03-21 19:26:05 [INFO    ] Finished processing BAM request
2019-03-21 19:26:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94388   8 58563 69965035 A  ERROR'
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:26:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:26:05 [DEBUG   ] spawn_process: at 2019-03-21 19:26:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:26:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 19:26:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:26:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:26:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:26:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:26:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:26:19 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-03-21 19:26:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:26:32 [DEBUG   ] Got command BAM from MCS: ref #94391
2019-03-21 19:26:32 [INFO    ] Finished processing BAM request
2019-03-21 19:26:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94391   8 58563 69992027 A  ERROR'
2019-03-21 19:26:32 [DEBUG   ] Got command BAM from MCS: ref #94390
2019-03-21 19:26:32 [INFO    ] Finished processing BAM request
2019-03-21 19:26:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94390   8 58563 69992031 A  ERROR'
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:26:32 [DEBUG   ] spawn_process: at 2019-03-21 19:26:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:26:44 [DEBUG   ] Got command RPT from MCS: ref #94394
2019-03-21 19:26:44 [DEBUG   ] summary = ERROR
2019-03-21 19:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94394  13 58563 70004683 A  ERRORERROR'
2019-03-21 19:26:44 [DEBUG   ] Got command RPT from MCS: ref #94395
2019-03-21 19:26:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94395  77 58563 70004887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:26:45 [DEBUG   ] Got command RPT from MCS: ref #94396
2019-03-21 19:26:45 [DEBUG   ] summary = ERROR
2019-03-21 19:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94396  13 58563 70005091 A  ERRORERROR'
2019-03-21 19:26:45 [DEBUG   ] Got command RPT from MCS: ref #94398
2019-03-21 19:26:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94398  77 58563 70005283 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:26:45 [DEBUG   ] Got command RPT from MCS: ref #94399
2019-03-21 19:26:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94399  12 58563 70005487 A  ERRORBš™š'
2019-03-21 19:26:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:26:59 [DEBUG   ] Got command BAM from MCS: ref #94410
2019-03-21 19:26:59 [INFO    ] Finished processing BAM request
2019-03-21 19:26:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94410   8 58563 70019031 A  ERROR'
2019-03-21 19:26:59 [DEBUG   ] Got command BAM from MCS: ref #94411
2019-03-21 19:26:59 [INFO    ] Finished processing BAM request
2019-03-21 19:26:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94411   8 58563 70019035 A  ERROR'
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:26:59 [DEBUG   ] spawn_process: at 2019-03-21 19:26:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:27:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:27:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:27:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:27:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:27:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:27:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:27:20 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-03-21 19:27:26 [DEBUG   ] Got command BAM from MCS: ref #94413
2019-03-21 19:27:26 [INFO    ] Finished processing BAM request
2019-03-21 19:27:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94413   8 58563 70046023 A  ERROR'
2019-03-21 19:27:26 [DEBUG   ] Got command BAM from MCS: ref #94412
2019-03-21 19:27:26 [INFO    ] Finished processing BAM request
2019-03-21 19:27:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94412   8 58563 70046027 A  ERROR'
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:27:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:27:26 [DEBUG   ] spawn_process: at 2019-03-21 19:27:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:27:29 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 19:27:40 [DEBUG   ] Got command RPT from MCS: ref #94414
2019-03-21 19:27:40 [DEBUG   ] summary = ERROR
2019-03-21 19:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94414  13 58563 70060839 A  ERRORERROR'
2019-03-21 19:27:40 [DEBUG   ] Got command RPT from MCS: ref #94415
2019-03-21 19:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94415  77 58563 70060839 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:27:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:27:53 [DEBUG   ] Got command BAM from MCS: ref #94432
2019-03-21 19:27:53 [INFO    ] Finished processing BAM request
2019-03-21 19:27:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:27:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94432   8 58563 70073027 A  ERROR'
2019-03-21 19:27:53 [DEBUG   ] Got command BAM from MCS: ref #94431
2019-03-21 19:27:53 [INFO    ] Finished processing BAM request
2019-03-21 19:27:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:27:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94431   8 58563 70073031 A  ERROR'
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:27:53 [DEBUG   ] spawn_process: at 2019-03-21 19:27:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:28:09 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 19:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:28:20 [DEBUG   ] Got command BAM from MCS: ref #94433
2019-03-21 19:28:20 [INFO    ] Finished processing BAM request
2019-03-21 19:28:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94433   8 58563 70100023 A  ERROR'
2019-03-21 19:28:20 [DEBUG   ] Got command BAM from MCS: ref #94434
2019-03-21 19:28:20 [INFO    ] Finished processing BAM request
2019-03-21 19:28:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94434   8 58563 70100027 A  ERROR'
2019-03-21 19:28:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:28:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:28:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:28:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:28:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:28:20 [DEBUG   ] Finished updating board flags in 1.832 seconds
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:28:20 [DEBUG   ] spawn_process: at 2019-03-21 19:28:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:28:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 19:28:47 [DEBUG   ] Got command BAM from MCS: ref #94435
2019-03-21 19:28:47 [INFO    ] Finished processing BAM request
2019-03-21 19:28:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:28:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94435   8 58563 70127023 A  ERROR'
2019-03-21 19:28:47 [DEBUG   ] Got command BAM from MCS: ref #94436
2019-03-21 19:28:47 [INFO    ] Finished processing BAM request
2019-03-21 19:28:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:28:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94436   8 58563 70127027 A  ERROR'
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:28:47 [DEBUG   ] spawn_process: at 2019-03-21 19:28:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:28:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:29:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:29:14 [DEBUG   ] Got command BAM from MCS: ref #94437
2019-03-21 19:29:14 [INFO    ] Finished processing BAM request
2019-03-21 19:29:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94437   8 58563 70154023 A  ERROR'
2019-03-21 19:29:14 [DEBUG   ] Got command BAM from MCS: ref #94438
2019-03-21 19:29:14 [INFO    ] Finished processing BAM request
2019-03-21 19:29:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94438   8 58563 70154027 A  ERROR'
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:29:14 [DEBUG   ] spawn_process: at 2019-03-21 19:29:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:29:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 19:29:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:29:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:29:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:29:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:29:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:29:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:29:20 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-03-21 19:29:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:29:41 [DEBUG   ] Got command BAM from MCS: ref #94440
2019-03-21 19:29:41 [INFO    ] Finished processing BAM request
2019-03-21 19:29:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94440   8 58563 70181023 A  ERROR'
2019-03-21 19:29:41 [DEBUG   ] Got command BAM from MCS: ref #94439
2019-03-21 19:29:41 [INFO    ] Finished processing BAM request
2019-03-21 19:29:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94439   8 58563 70181027 A  ERROR'
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:29:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:29:41 [DEBUG   ] spawn_process: at 2019-03-21 19:29:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:29:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:30:08 [DEBUG   ] Got command BAM from MCS: ref #94448
2019-03-21 19:30:08 [INFO    ] Finished processing BAM request
2019-03-21 19:30:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94448   8 58563 70208027 A  ERROR'
2019-03-21 19:30:08 [DEBUG   ] Got command BAM from MCS: ref #94447
2019-03-21 19:30:08 [INFO    ] Finished processing BAM request
2019-03-21 19:30:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94447   8 58563 70208031 A  ERROR'
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:30:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:30:08 [DEBUG   ] spawn_process: at 2019-03-21 19:30:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:30:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:30:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:30:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:30:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:30:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:30:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:30:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:30:20 [DEBUG   ] Finished updating board flags in 1.765 seconds
2019-03-21 19:30:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:30:35 [DEBUG   ] Got command BAM from MCS: ref #94449
2019-03-21 19:30:35 [INFO    ] Finished processing BAM request
2019-03-21 19:30:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:30:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94449   8 58563 70235027 A  ERROR'
2019-03-21 19:30:35 [DEBUG   ] Got command BAM from MCS: ref #94450
2019-03-21 19:30:35 [INFO    ] Finished processing BAM request
2019-03-21 19:30:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:30:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94450   8 58563 70235031 A  ERROR'
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:30:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:30:35 [DEBUG   ] spawn_process: at 2019-03-21 19:30:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:30:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:31:02 [DEBUG   ] Got command BAM from MCS: ref #94451
2019-03-21 19:31:02 [INFO    ] Finished processing BAM request
2019-03-21 19:31:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94451   8 58563 70262027 A  ERROR'
2019-03-21 19:31:02 [DEBUG   ] Got command BAM from MCS: ref #94452
2019-03-21 19:31:02 [INFO    ] Finished processing BAM request
2019-03-21 19:31:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:31:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94452   8 58563 70262031 A  ERROR'
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:31:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:31:02 [DEBUG   ] spawn_process: at 2019-03-21 19:31:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:31:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 19:31:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:31:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:31:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:31:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:31:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:31:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:31:20 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-03-21 19:31:29 [DEBUG   ] Got command BAM from MCS: ref #94454
2019-03-21 19:31:29 [INFO    ] Finished processing BAM request
2019-03-21 19:31:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94454   8 58563 70289023 A  ERROR'
2019-03-21 19:31:29 [DEBUG   ] Got command BAM from MCS: ref #94453
2019-03-21 19:31:29 [INFO    ] Finished processing BAM request
2019-03-21 19:31:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94453   8 58563 70289027 A  ERROR'
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:31:29 [DEBUG   ] spawn_process: at 2019-03-21 19:31:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:31:30 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 19:31:44 [DEBUG   ] Got command RPT from MCS: ref #94455
2019-03-21 19:31:44 [DEBUG   ] summary = ERROR
2019-03-21 19:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94455  13 58563 70304767 A  ERRORERROR'
2019-03-21 19:31:44 [DEBUG   ] Got command RPT from MCS: ref #94456
2019-03-21 19:31:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94456  77 58563 70304971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:31:45 [DEBUG   ] Got command RPT from MCS: ref #94457
2019-03-21 19:31:45 [DEBUG   ] summary = ERROR
2019-03-21 19:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94457  13 58563 70305175 A  ERRORERROR'
2019-03-21 19:31:45 [DEBUG   ] Got command RPT from MCS: ref #94458
2019-03-21 19:31:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94458  77 58563 70305379 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:31:45 [DEBUG   ] Got command RPT from MCS: ref #94459
2019-03-21 19:31:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94459  12 58563 70305571 A  ERRORBš™š'
2019-03-21 19:31:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 19:31:56 [DEBUG   ] Got command BAM from MCS: ref #94460
2019-03-21 19:31:56 [INFO    ] Finished processing BAM request
2019-03-21 19:31:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94460   8 58563 70316027 A  ERROR'
2019-03-21 19:31:56 [DEBUG   ] Got command BAM from MCS: ref #94461
2019-03-21 19:31:56 [INFO    ] Finished processing BAM request
2019-03-21 19:31:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94461   8 58563 70316031 A  ERROR'
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:31:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:31:56 [DEBUG   ] spawn_process: at 2019-03-21 19:31:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:32:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 19:32:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:32:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:32:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:32:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:32:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:32:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:32:19 [DEBUG   ] Finished updating board flags in 1.037 seconds
2019-03-21 19:32:23 [DEBUG   ] Got command BAM from MCS: ref #94463
2019-03-21 19:32:23 [INFO    ] Finished processing BAM request
2019-03-21 19:32:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94463   8 58563 70343031 A  ERROR'
2019-03-21 19:32:23 [DEBUG   ] Got command BAM from MCS: ref #94462
2019-03-21 19:32:23 [INFO    ] Finished processing BAM request
2019-03-21 19:32:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94462   8 58563 70343035 A  ERROR'
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:32:23 [DEBUG   ] spawn_process: at 2019-03-21 19:32:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:32:30 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 19:32:40 [DEBUG   ] Got command RPT from MCS: ref #94464
2019-03-21 19:32:40 [DEBUG   ] summary = ERROR
2019-03-21 19:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94464  13 58563 70360835 A  ERRORERROR'
2019-03-21 19:32:40 [DEBUG   ] Got command RPT from MCS: ref #94465
2019-03-21 19:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94465  77 58563 70360835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:32:50 [DEBUG   ] Got command BAM from MCS: ref #94488
2019-03-21 19:32:50 [INFO    ] Finished processing BAM request
2019-03-21 19:32:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:32:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94488   8 58563 70370031 A  ERROR'
2019-03-21 19:32:50 [DEBUG   ] Got command BAM from MCS: ref #94487
2019-03-21 19:32:50 [INFO    ] Finished processing BAM request
2019-03-21 19:32:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:32:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94487   8 58563 70370035 A  ERROR'
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:32:50 [DEBUG   ] spawn_process: at 2019-03-21 19:32:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:32:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:33:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:33:17 [DEBUG   ] Got command BAM from MCS: ref #94490
2019-03-21 19:33:17 [INFO    ] Finished processing BAM request
2019-03-21 19:33:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94490   8 58563 70397027 A  ERROR'
2019-03-21 19:33:17 [DEBUG   ] Got command BAM from MCS: ref #94489
2019-03-21 19:33:17 [INFO    ] Finished processing BAM request
2019-03-21 19:33:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94489   8 58563 70397031 A  ERROR'
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:33:17 [DEBUG   ] spawn_process: at 2019-03-21 19:33:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:33:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:33:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:33:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:33:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:33:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:33:19 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-03-21 19:33:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:33:44 [DEBUG   ] Got command BAM from MCS: ref #94491
2019-03-21 19:33:44 [INFO    ] Finished processing BAM request
2019-03-21 19:33:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94491   8 58563 70424031 A  ERROR'
2019-03-21 19:33:44 [DEBUG   ] Got command BAM from MCS: ref #94492
2019-03-21 19:33:44 [INFO    ] Finished processing BAM request
2019-03-21 19:33:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:33:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94492   8 58563 70424035 A  ERROR'
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:33:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:33:44 [DEBUG   ] spawn_process: at 2019-03-21 19:33:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:33:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:34:11 [DEBUG   ] Got command BAM from MCS: ref #94494
2019-03-21 19:34:11 [INFO    ] Finished processing BAM request
2019-03-21 19:34:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94494   8 58563 70451023 A  ERROR'
2019-03-21 19:34:11 [DEBUG   ] Got command BAM from MCS: ref #94493
2019-03-21 19:34:11 [INFO    ] Finished processing BAM request
2019-03-21 19:34:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94493   8 58563 70451027 A  ERROR'
2019-03-21 19:34:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:34:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:34:11 [DEBUG   ] spawn_process: at 2019-03-21 19:34:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:34:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 19:34:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:34:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:34:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:34:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:34:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:34:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:34:19 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-03-21 19:34:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:34:38 [DEBUG   ] Got command BAM from MCS: ref #94496
2019-03-21 19:34:38 [INFO    ] Finished processing BAM request
2019-03-21 19:34:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94496   8 58563 70478027 A  ERROR'
2019-03-21 19:34:38 [DEBUG   ] Got command BAM from MCS: ref #94495
2019-03-21 19:34:38 [INFO    ] Finished processing BAM request
2019-03-21 19:34:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94495   8 58563 70478031 A  ERROR'
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:34:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:34:38 [DEBUG   ] spawn_process: at 2019-03-21 19:34:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:34:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:35:05 [DEBUG   ] Got command BAM from MCS: ref #94498
2019-03-21 19:35:05 [INFO    ] Finished processing BAM request
2019-03-21 19:35:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94498   8 58563 70505031 A  ERROR'
2019-03-21 19:35:05 [DEBUG   ] Got command BAM from MCS: ref #94497
2019-03-21 19:35:05 [INFO    ] Finished processing BAM request
2019-03-21 19:35:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94497   8 58563 70505035 A  ERROR'
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:35:05 [DEBUG   ] spawn_process: at 2019-03-21 19:35:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:35:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 19:35:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:35:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:35:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:35:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:35:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:35:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:35:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:35:19 [DEBUG   ] Finished updating board flags in 1.038 seconds
2019-03-21 19:35:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 19:35:32 [DEBUG   ] Got command BAM from MCS: ref #94499
2019-03-21 19:35:32 [INFO    ] Finished processing BAM request
2019-03-21 19:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94499   8 58563 70532027 A  ERROR'
2019-03-21 19:35:32 [DEBUG   ] Got command BAM from MCS: ref #94500
2019-03-21 19:35:32 [INFO    ] Finished processing BAM request
2019-03-21 19:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94500   8 58563 70532031 A  ERROR'
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:35:32 [DEBUG   ] spawn_process: at 2019-03-21 19:35:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:35:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:36:00 [DEBUG   ] Got command BAM from MCS: ref #94507
2019-03-21 19:36:00 [INFO    ] Finished processing BAM request
2019-03-21 19:36:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94507   8 58563 70560027 A  ERROR'
2019-03-21 19:36:00 [DEBUG   ] Got command BAM from MCS: ref #94508
2019-03-21 19:36:00 [INFO    ] Finished processing BAM request
2019-03-21 19:36:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94508   8 58563 70560031 A  ERROR'
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:36:00 [DEBUG   ] spawn_process: at 2019-03-21 19:36:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:36:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 19:36:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:36:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:36:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:36:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:36:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:36:19 [WARNING ] (13, 1, 'bot')
2019-03-21 19:36:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:36:19 [DEBUG   ] Finished updating board flags in 0.946 seconds
2019-03-21 19:36:28 [DEBUG   ] Got command BAM from MCS: ref #94510
2019-03-21 19:36:28 [INFO    ] Finished processing BAM request
2019-03-21 19:36:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94510   8 58563 70588023 A  ERROR'
2019-03-21 19:36:28 [DEBUG   ] Got command BAM from MCS: ref #94509
2019-03-21 19:36:28 [INFO    ] Finished processing BAM request
2019-03-21 19:36:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94509   8 58563 70588027 A  ERROR'
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:36:28 [DEBUG   ] spawn_process: at 2019-03-21 19:36:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:36:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:36:44 [DEBUG   ] Got command RPT from MCS: ref #94513
2019-03-21 19:36:44 [DEBUG   ] summary = ERROR
2019-03-21 19:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94513  13 58563 70604859 A  ERRORERROR'
2019-03-21 19:36:45 [DEBUG   ] Got command RPT from MCS: ref #94514
2019-03-21 19:36:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94514  77 58563 70605063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:36:45 [DEBUG   ] Got command RPT from MCS: ref #94515
2019-03-21 19:36:45 [DEBUG   ] summary = ERROR
2019-03-21 19:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94515  13 58563 70605255 A  ERRORERROR'
2019-03-21 19:36:45 [DEBUG   ] Got command RPT from MCS: ref #94517
2019-03-21 19:36:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94517  77 58563 70605459 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:36:45 [DEBUG   ] Got command RPT from MCS: ref #94518
2019-03-21 19:36:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94518  12 58563 70605663 A  ERRORB™™š'
2019-03-21 19:36:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:36:56 [DEBUG   ] Got command BAM from MCS: ref #94524
2019-03-21 19:36:56 [INFO    ] Finished processing BAM request
2019-03-21 19:36:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94524   8 58563 70616023 A  ERROR'
2019-03-21 19:36:56 [DEBUG   ] Got command BAM from MCS: ref #94523
2019-03-21 19:36:56 [INFO    ] Finished processing BAM request
2019-03-21 19:36:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94523   8 58563 70616027 A  ERROR'
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:36:56 [DEBUG   ] spawn_process: at 2019-03-21 19:36:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:37:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:37:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 19:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:37:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:37:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:37:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:37:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:37:20 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-03-21 19:37:24 [DEBUG   ] Got command BAM from MCS: ref #94526
2019-03-21 19:37:24 [INFO    ] Finished processing BAM request
2019-03-21 19:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94526   8 58563 70644027 A  ERROR'
2019-03-21 19:37:24 [DEBUG   ] Got command BAM from MCS: ref #94525
2019-03-21 19:37:24 [INFO    ] Finished processing BAM request
2019-03-21 19:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94525   8 58563 70644031 A  ERROR'
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:37:24 [DEBUG   ] spawn_process: at 2019-03-21 19:37:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:37:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:37:40 [DEBUG   ] Got command RPT from MCS: ref #94527
2019-03-21 19:37:40 [DEBUG   ] summary = ERROR
2019-03-21 19:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94527  13 58563 70660839 A  ERRORERROR'
2019-03-21 19:37:40 [DEBUG   ] Got command RPT from MCS: ref #94528
2019-03-21 19:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94528  77 58563 70660839 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:37:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:37:52 [DEBUG   ] Got command BAM from MCS: ref #94545
2019-03-21 19:37:52 [INFO    ] Finished processing BAM request
2019-03-21 19:37:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:37:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94545   8 58563 70672023 A  ERROR'
2019-03-21 19:37:52 [DEBUG   ] Got command BAM from MCS: ref #94544
2019-03-21 19:37:52 [INFO    ] Finished processing BAM request
2019-03-21 19:37:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:37:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94544   8 58563 70672027 A  ERROR'
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:37:52 [DEBUG   ] spawn_process: at 2019-03-21 19:37:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:38:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:38:20 [DEBUG   ] Got command BAM from MCS: ref #94547
2019-03-21 19:38:20 [INFO    ] Finished processing BAM request
2019-03-21 19:38:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94547   8 58563 70700031 A  ERROR'
2019-03-21 19:38:20 [DEBUG   ] Got command BAM from MCS: ref #94546
2019-03-21 19:38:20 [INFO    ] Finished processing BAM request
2019-03-21 19:38:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94546   8 58563 70700035 A  ERROR'
2019-03-21 19:38:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:38:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:38:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:38:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:38:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:38:20 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:38:20 [DEBUG   ] spawn_process: at 2019-03-21 19:38:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:38:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:38:48 [DEBUG   ] Got command BAM from MCS: ref #94551
2019-03-21 19:38:48 [INFO    ] Finished processing BAM request
2019-03-21 19:38:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94551   8 58563 70728031 A  ERROR'
2019-03-21 19:38:48 [DEBUG   ] Got command BAM from MCS: ref #94550
2019-03-21 19:38:48 [INFO    ] Finished processing BAM request
2019-03-21 19:38:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94550   8 58563 70728035 A  ERROR'
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:38:48 [DEBUG   ] spawn_process: at 2019-03-21 19:38:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:38:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:39:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:39:16 [DEBUG   ] Got command BAM from MCS: ref #94557
2019-03-21 19:39:16 [INFO    ] Finished processing BAM request
2019-03-21 19:39:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94557   8 58563 70756031 A  ERROR'
2019-03-21 19:39:16 [DEBUG   ] Got command BAM from MCS: ref #94556
2019-03-21 19:39:16 [INFO    ] Finished processing BAM request
2019-03-21 19:39:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94556   8 58563 70756035 A  ERROR'
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:39:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:39:16 [DEBUG   ] spawn_process: at 2019-03-21 19:39:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:39:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:39:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:39:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:39:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:39:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:39:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:39:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:39:20 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-03-21 19:39:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:39:44 [DEBUG   ] Got command BAM from MCS: ref #94559
2019-03-21 19:39:44 [INFO    ] Finished processing BAM request
2019-03-21 19:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94559   8 58563 70784027 A  ERROR'
2019-03-21 19:39:44 [DEBUG   ] Got command BAM from MCS: ref #94558
2019-03-21 19:39:44 [INFO    ] Finished processing BAM request
2019-03-21 19:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94558   8 58563 70784031 A  ERROR'
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:39:44 [DEBUG   ] spawn_process: at 2019-03-21 19:39:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:39:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 19:40:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 19:40:12 [DEBUG   ] Got command BAM from MCS: ref #94561
2019-03-21 19:40:12 [INFO    ] Finished processing BAM request
2019-03-21 19:40:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94561   8 58563 70812023 A  ERROR'
2019-03-21 19:40:12 [DEBUG   ] Got command BAM from MCS: ref #94560
2019-03-21 19:40:12 [INFO    ] Finished processing BAM request
2019-03-21 19:40:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94560   8 58563 70812027 A  ERROR'
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:40:12 [DEBUG   ] spawn_process: at 2019-03-21 19:40:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:40:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:40:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:40:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:40:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:40:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:40:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:40:20 [DEBUG   ] Finished updating board flags in 1.037 seconds
2019-03-21 19:40:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:40:40 [DEBUG   ] Got command BAM from MCS: ref #94562
2019-03-21 19:40:40 [INFO    ] Finished processing BAM request
2019-03-21 19:40:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94562   8 58563 70840031 A  ERROR'
2019-03-21 19:40:40 [DEBUG   ] Got command BAM from MCS: ref #94563
2019-03-21 19:40:40 [INFO    ] Finished processing BAM request
2019-03-21 19:40:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94563   8 58563 70840035 A  ERROR'
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:40:40 [DEBUG   ] spawn_process: at 2019-03-21 19:40:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:40:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 19:41:08 [DEBUG   ] Got command BAM from MCS: ref #94564
2019-03-21 19:41:08 [INFO    ] Finished processing BAM request
2019-03-21 19:41:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94564   8 58563 70868031 A  ERROR'
2019-03-21 19:41:08 [DEBUG   ] Got command BAM from MCS: ref #94565
2019-03-21 19:41:08 [INFO    ] Finished processing BAM request
2019-03-21 19:41:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94565   8 58563 70868035 A  ERROR'
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:41:08 [DEBUG   ] spawn_process: at 2019-03-21 19:41:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:41:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:41:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:41:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:41:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:41:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:41:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:41:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:41:21 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-03-21 19:41:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:41:36 [DEBUG   ] Got command BAM from MCS: ref #94567
2019-03-21 19:41:36 [INFO    ] Finished processing BAM request
2019-03-21 19:41:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94567   8 58563 70896027 A  ERROR'
2019-03-21 19:41:36 [DEBUG   ] Got command BAM from MCS: ref #94566
2019-03-21 19:41:36 [INFO    ] Finished processing BAM request
2019-03-21 19:41:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94566   8 58563 70896031 A  ERROR'
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:41:36 [DEBUG   ] spawn_process: at 2019-03-21 19:41:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:41:44 [DEBUG   ] Got command RPT from MCS: ref #94568
2019-03-21 19:41:44 [DEBUG   ] summary = ERROR
2019-03-21 19:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94568  13 58563 70904947 A  ERRORERROR'
2019-03-21 19:41:45 [DEBUG   ] Got command RPT from MCS: ref #94569
2019-03-21 19:41:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94569  77 58563 70905151 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:41:45 [DEBUG   ] Got command RPT from MCS: ref #94570
2019-03-21 19:41:45 [DEBUG   ] summary = ERROR
2019-03-21 19:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94570  13 58563 70905343 A  ERRORERROR'
2019-03-21 19:41:45 [DEBUG   ] Got command RPT from MCS: ref #94571
2019-03-21 19:41:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94571  77 58563 70905547 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:41:45 [DEBUG   ] Got command RPT from MCS: ref #94572
2019-03-21 19:41:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94572  12 58563 70905751 A  ERRORBš™š'
2019-03-21 19:41:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:42:04 [DEBUG   ] Got command BAM from MCS: ref #94579
2019-03-21 19:42:04 [INFO    ] Finished processing BAM request
2019-03-21 19:42:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:42:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94579   8 58563 70924031 A  ERROR'
2019-03-21 19:42:04 [DEBUG   ] Got command BAM from MCS: ref #94580
2019-03-21 19:42:04 [INFO    ] Finished processing BAM request
2019-03-21 19:42:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:42:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94580   8 58563 70924035 A  ERROR'
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:42:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:42:04 [DEBUG   ] spawn_process: at 2019-03-21 19:42:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:42:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:42:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:42:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:42:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:42:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:42:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:42:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:42:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:42:21 [DEBUG   ] Finished updating board flags in 1.955 seconds
2019-03-21 19:42:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:42:32 [DEBUG   ] Got command BAM from MCS: ref #94581
2019-03-21 19:42:32 [INFO    ] Finished processing BAM request
2019-03-21 19:42:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94581   8 58563 70952027 A  ERROR'
2019-03-21 19:42:32 [DEBUG   ] Got command BAM from MCS: ref #94582
2019-03-21 19:42:32 [INFO    ] Finished processing BAM request
2019-03-21 19:42:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94582   8 58563 70952031 A  ERROR'
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:42:32 [DEBUG   ] spawn_process: at 2019-03-21 19:42:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:42:40 [DEBUG   ] Got command RPT from MCS: ref #94583
2019-03-21 19:42:40 [DEBUG   ] summary = ERROR
2019-03-21 19:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94583  13 58563 70960843 A  ERRORERROR'
2019-03-21 19:42:40 [DEBUG   ] Got command RPT from MCS: ref #94584
2019-03-21 19:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94584  77 58563 70960843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:42:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:43:00 [DEBUG   ] Got command BAM from MCS: ref #94601
2019-03-21 19:43:00 [INFO    ] Finished processing BAM request
2019-03-21 19:43:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94601   8 58563 70980027 A  ERROR'
2019-03-21 19:43:00 [DEBUG   ] Got command BAM from MCS: ref #94600
2019-03-21 19:43:00 [INFO    ] Finished processing BAM request
2019-03-21 19:43:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94600   8 58563 70980031 A  ERROR'
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:43:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:43:00 [DEBUG   ] spawn_process: at 2019-03-21 19:43:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:43:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 19:43:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:43:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 19:43:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:43:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:43:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:43:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:43:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:43:20 [DEBUG   ] Finished updating board flags in 1.253 seconds
2019-03-21 19:43:28 [DEBUG   ] Got command BAM from MCS: ref #94603
2019-03-21 19:43:28 [INFO    ] Finished processing BAM request
2019-03-21 19:43:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94603   8 58563 71008027 A  ERROR'
2019-03-21 19:43:28 [DEBUG   ] Got command BAM from MCS: ref #94602
2019-03-21 19:43:28 [INFO    ] Finished processing BAM request
2019-03-21 19:43:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94602   8 58563 71008031 A  ERROR'
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:43:28 [DEBUG   ] spawn_process: at 2019-03-21 19:43:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:43:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:43:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:43:56 [DEBUG   ] Got command BAM from MCS: ref #94604
2019-03-21 19:43:56 [INFO    ] Finished processing BAM request
2019-03-21 19:43:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94604   8 58563 71036023 A  ERROR'
2019-03-21 19:43:56 [DEBUG   ] Got command BAM from MCS: ref #94605
2019-03-21 19:43:56 [INFO    ] Finished processing BAM request
2019-03-21 19:43:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94605   8 58563 71036027 A  ERROR'
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:43:56 [DEBUG   ] spawn_process: at 2019-03-21 19:43:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:44:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:44:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:44:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:44:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:44:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:44:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:44:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:44:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:44:20 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-03-21 19:44:24 [DEBUG   ] Got command BAM from MCS: ref #94606
2019-03-21 19:44:24 [INFO    ] Finished processing BAM request
2019-03-21 19:44:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94606   8 58563 71064035 A  ERROR'
2019-03-21 19:44:24 [DEBUG   ] Got command BAM from MCS: ref #94607
2019-03-21 19:44:24 [INFO    ] Finished processing BAM request
2019-03-21 19:44:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94607   8 58563 71064039 A  ERROR'
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:44:24 [DEBUG   ] spawn_process: at 2019-03-21 19:44:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:44:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:44:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 19:44:52 [DEBUG   ] Got command BAM from MCS: ref #94615
2019-03-21 19:44:52 [INFO    ] Finished processing BAM request
2019-03-21 19:44:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94615   8 58563 71092023 A  ERROR'
2019-03-21 19:44:52 [DEBUG   ] Got command BAM from MCS: ref #94614
2019-03-21 19:44:52 [INFO    ] Finished processing BAM request
2019-03-21 19:44:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94614   8 58563 71092027 A  ERROR'
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:44:52 [DEBUG   ] spawn_process: at 2019-03-21 19:44:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:45:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 19:45:20 [DEBUG   ] Got command BAM from MCS: ref #94617
2019-03-21 19:45:20 [INFO    ] Finished processing BAM request
2019-03-21 19:45:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94617   8 58563 71120035 A  ERROR'
2019-03-21 19:45:20 [DEBUG   ] Got command BAM from MCS: ref #94616
2019-03-21 19:45:20 [INFO    ] Finished processing BAM request
2019-03-21 19:45:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94616   8 58563 71120043 A  ERROR'
2019-03-21 19:45:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 19:45:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:45:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:45:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:45:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:45:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:45:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:45:20 [DEBUG   ] Finished updating board flags in 1.228 seconds
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:45:20 [DEBUG   ] spawn_process: at 2019-03-21 19:45:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:45:31 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 19:45:48 [DEBUG   ] Got command BAM from MCS: ref #94618
2019-03-21 19:45:48 [INFO    ] Finished processing BAM request
2019-03-21 19:45:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94618   8 58563 71148027 A  ERROR'
2019-03-21 19:45:48 [DEBUG   ] Got command BAM from MCS: ref #94619
2019-03-21 19:45:48 [INFO    ] Finished processing BAM request
2019-03-21 19:45:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94619   8 58563 71148031 A  ERROR'
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:45:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:45:48 [DEBUG   ] spawn_process: at 2019-03-21 19:45:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:45:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:46:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:46:16 [DEBUG   ] Got command BAM from MCS: ref #94620
2019-03-21 19:46:16 [INFO    ] Finished processing BAM request
2019-03-21 19:46:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:46:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94620   8 58563 71176027 A  ERROR'
2019-03-21 19:46:16 [DEBUG   ] Got command BAM from MCS: ref #94621
2019-03-21 19:46:16 [INFO    ] Finished processing BAM request
2019-03-21 19:46:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:46:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94621   8 58563 71176031 A  ERROR'
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:46:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:46:16 [DEBUG   ] spawn_process: at 2019-03-21 19:46:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:46:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 19:46:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:46:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:46:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:46:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:46:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:46:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:46:20 [DEBUG   ] Finished updating board flags in 1.157 seconds
2019-03-21 19:46:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:46:44 [DEBUG   ] Got command BAM from MCS: ref #94624
2019-03-21 19:46:44 [INFO    ] Finished processing BAM request
2019-03-21 19:46:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94624   8 58563 71204023 A  ERROR'
2019-03-21 19:46:44 [DEBUG   ] Got command BAM from MCS: ref #94625
2019-03-21 19:46:44 [INFO    ] Finished processing BAM request
2019-03-21 19:46:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94625   8 58563 71204027 A  ERROR'
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:46:44 [DEBUG   ] spawn_process: at 2019-03-21 19:46:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:46:45 [DEBUG   ] Got command RPT from MCS: ref #94626
2019-03-21 19:46:45 [DEBUG   ] summary = ERROR
2019-03-21 19:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94626  13 58563 71205023 A  ERRORERROR'
2019-03-21 19:46:45 [DEBUG   ] Got command RPT from MCS: ref #94627
2019-03-21 19:46:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94627  77 58563 71205227 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:46:45 [DEBUG   ] Got command RPT from MCS: ref #94628
2019-03-21 19:46:45 [DEBUG   ] summary = ERROR
2019-03-21 19:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94628  13 58563 71205431 A  ERRORERROR'
2019-03-21 19:46:45 [DEBUG   ] Got command RPT from MCS: ref #94629
2019-03-21 19:46:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94629  77 58563 71205623 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:46:45 [DEBUG   ] Got command RPT from MCS: ref #94631
2019-03-21 19:46:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94631  12 58563 71205827 A  ERRORB›™š'
2019-03-21 19:46:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:47:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 19:47:12 [DEBUG   ] Got command BAM from MCS: ref #94636
2019-03-21 19:47:12 [INFO    ] Finished processing BAM request
2019-03-21 19:47:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94636   8 58563 71232031 A  ERROR'
2019-03-21 19:47:12 [DEBUG   ] Got command BAM from MCS: ref #94637
2019-03-21 19:47:12 [INFO    ] Finished processing BAM request
2019-03-21 19:47:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94637   8 58563 71232035 A  ERROR'
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:47:12 [DEBUG   ] spawn_process: at 2019-03-21 19:47:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:47:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 19:47:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:47:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:47:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:47:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:47:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:47:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:47:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:47:20 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-03-21 19:47:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:47:40 [DEBUG   ] Got command BAM from MCS: ref #94638
2019-03-21 19:47:40 [INFO    ] Finished processing BAM request
2019-03-21 19:47:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94638   8 58563 71260023 A  ERROR'
2019-03-21 19:47:40 [DEBUG   ] Got command BAM from MCS: ref #94639
2019-03-21 19:47:40 [INFO    ] Finished processing BAM request
2019-03-21 19:47:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94639   8 58563 71260027 A  ERROR'
2019-03-21 19:47:40 [DEBUG   ] Got command RPT from MCS: ref #94640
2019-03-21 19:47:40 [DEBUG   ] summary = ERROR
2019-03-21 19:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94640  13 58563 71260843 A  ERRORERROR'
2019-03-21 19:47:40 [DEBUG   ] Got command RPT from MCS: ref #94641
2019-03-21 19:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94641  77 58563 71260843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:47:40 [DEBUG   ] spawn_process: at 2019-03-21 19:47:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:47:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:48:08 [DEBUG   ] Got command BAM from MCS: ref #94664
2019-03-21 19:48:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:48:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94664   8 58563 71288023 A  ERROR'
2019-03-21 19:48:08 [DEBUG   ] Got command BAM from MCS: ref #94663
2019-03-21 19:48:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:48:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94663   8 58563 71288027 A  ERROR'
2019-03-21 19:48:08 [INFO    ] Finished processing BAM request
2019-03-21 19:48:08 [INFO    ] Finished processing BAM request
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:48:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:48:08 [DEBUG   ] spawn_process: at 2019-03-21 19:48:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:48:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:48:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:48:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:48:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:48:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:48:20 [WARNING ] (13, 1, 'bot')
2019-03-21 19:48:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:48:20 [DEBUG   ] Finished updating board flags in 1.053 seconds
2019-03-21 19:48:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:48:36 [DEBUG   ] Got command BAM from MCS: ref #94665
2019-03-21 19:48:36 [INFO    ] Finished processing BAM request
2019-03-21 19:48:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94665   8 58563 71316023 A  ERROR'
2019-03-21 19:48:36 [DEBUG   ] Got command BAM from MCS: ref #94666
2019-03-21 19:48:36 [INFO    ] Finished processing BAM request
2019-03-21 19:48:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94666   8 58563 71316027 A  ERROR'
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:48:36 [DEBUG   ] spawn_process: at 2019-03-21 19:48:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:48:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:49:04 [DEBUG   ] Got command BAM from MCS: ref #94668
2019-03-21 19:49:04 [INFO    ] Finished processing BAM request
2019-03-21 19:49:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:49:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94668   8 58563 71344023 A  ERROR'
2019-03-21 19:49:04 [DEBUG   ] Got command BAM from MCS: ref #94667
2019-03-21 19:49:04 [INFO    ] Finished processing BAM request
2019-03-21 19:49:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:49:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94667   8 58563 71344027 A  ERROR'
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:49:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:49:04 [DEBUG   ] spawn_process: at 2019-03-21 19:49:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:49:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:49:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:49:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:49:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:49:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:49:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:49:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:49:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:49:21 [DEBUG   ] Finished updating board flags in 1.541 seconds
2019-03-21 19:49:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:49:32 [DEBUG   ] Got command BAM from MCS: ref #94670
2019-03-21 19:49:32 [INFO    ] Finished processing BAM request
2019-03-21 19:49:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:49:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94670   8 58563 71372031 A  ERROR'
2019-03-21 19:49:32 [DEBUG   ] Got command BAM from MCS: ref #94669
2019-03-21 19:49:32 [INFO    ] Finished processing BAM request
2019-03-21 19:49:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:49:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94669   8 58563 71372035 A  ERROR'
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:49:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:49:32 [DEBUG   ] spawn_process: at 2019-03-21 19:49:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:49:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:50:00 [DEBUG   ] Got command BAM from MCS: ref #94671
2019-03-21 19:50:00 [INFO    ] Finished processing BAM request
2019-03-21 19:50:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94671   8 58563 71400031 A  ERROR'
2019-03-21 19:50:00 [DEBUG   ] Got command BAM from MCS: ref #94672
2019-03-21 19:50:00 [INFO    ] Finished processing BAM request
2019-03-21 19:50:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94672   8 58563 71400035 A  ERROR'
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:50:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:50:00 [DEBUG   ] spawn_process: at 2019-03-21 19:50:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:50:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 19:50:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:50:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:50:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:50:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:50:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:50:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:50:21 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-03-21 19:50:28 [DEBUG   ] Got command BAM from MCS: ref #94674
2019-03-21 19:50:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94674   8 58563 71428031 A  ERROR'
2019-03-21 19:50:28 [DEBUG   ] Got command BAM from MCS: ref #94673
2019-03-21 19:50:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94673   8 58563 71428035 A  ERROR'
2019-03-21 19:50:28 [INFO    ] Finished processing BAM request
2019-03-21 19:50:28 [INFO    ] Finished processing BAM request
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:50:28 [DEBUG   ] spawn_process: at 2019-03-21 19:50:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:50:31 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-21 19:50:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:50:56 [DEBUG   ] Got command BAM from MCS: ref #94681
2019-03-21 19:50:56 [INFO    ] Finished processing BAM request
2019-03-21 19:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94681   8 58563 71456027 A  ERROR'
2019-03-21 19:50:56 [DEBUG   ] Got command BAM from MCS: ref #94682
2019-03-21 19:50:56 [INFO    ] Finished processing BAM request
2019-03-21 19:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94682   8 58563 71456031 A  ERROR'
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:50:56 [DEBUG   ] spawn_process: at 2019-03-21 19:50:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:51:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:51:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 19:51:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:51:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:51:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:51:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:51:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:51:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:51:21 [DEBUG   ] Finished updating board flags in 1.331 seconds
2019-03-21 19:51:24 [DEBUG   ] Got command BAM from MCS: ref #94684
2019-03-21 19:51:24 [INFO    ] Finished processing BAM request
2019-03-21 19:51:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:51:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94684   8 58563 71484031 A  ERROR'
2019-03-21 19:51:24 [DEBUG   ] Got command BAM from MCS: ref #94683
2019-03-21 19:51:24 [INFO    ] Finished processing BAM request
2019-03-21 19:51:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:51:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94683   8 58563 71484035 A  ERROR'
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:51:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:51:24 [DEBUG   ] spawn_process: at 2019-03-21 19:51:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:51:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 19:51:45 [DEBUG   ] Got command RPT from MCS: ref #94685
2019-03-21 19:51:45 [DEBUG   ] summary = ERROR
2019-03-21 19:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94685  13 58563 71505115 A  ERRORERROR'
2019-03-21 19:51:45 [DEBUG   ] Got command RPT from MCS: ref #94686
2019-03-21 19:51:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94686  77 58563 71505307 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:51:45 [DEBUG   ] Got command RPT from MCS: ref #94687
2019-03-21 19:51:45 [DEBUG   ] summary = ERROR
2019-03-21 19:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94687  13 58563 71505511 A  ERRORERROR'
2019-03-21 19:51:45 [DEBUG   ] Got command RPT from MCS: ref #94688
2019-03-21 19:51:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94688  77 58563 71505715 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:51:45 [DEBUG   ] Got command RPT from MCS: ref #94689
2019-03-21 19:51:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94689  12 58563 71505911 A  ERRORB›™š'
2019-03-21 19:51:52 [DEBUG   ] Got command BAM from MCS: ref #94691
2019-03-21 19:51:52 [INFO    ] Finished processing BAM request
2019-03-21 19:51:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94691   8 58563 71512031 A  ERROR'
2019-03-21 19:51:52 [DEBUG   ] Got command BAM from MCS: ref #94690
2019-03-21 19:51:52 [INFO    ] Finished processing BAM request
2019-03-21 19:51:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94690   8 58563 71512039 A  ERROR'
2019-03-21 19:51:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 19:51:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 19:51:52 [DEBUG   ] spawn_process: at 2019-03-21 19:51:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 19:52:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 19:52:20 [DEBUG   ] Got command BAM from MCS: ref #94693
2019-03-21 19:52:20 [INFO    ] Finished processing BAM request
2019-03-21 19:52:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94693   8 58563 71540031 A  ERROR'
2019-03-21 19:52:20 [DEBUG   ] Got command BAM from MCS: ref #94692
2019-03-21 19:52:20 [INFO    ] Finished processing BAM request
2019-03-21 19:52:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94692   8 58563 71540035 A  ERROR'
2019-03-21 19:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:52:20 [DEBUG   ] spawn_process: at 2019-03-21 19:52:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:52:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:52:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:52:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:52:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:52:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:52:21 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-03-21 19:52:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 19:52:40 [DEBUG   ] Got command RPT from MCS: ref #94694
2019-03-21 19:52:40 [DEBUG   ] summary = ERROR
2019-03-21 19:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94694  13 58563 71560839 A  ERRORERROR'
2019-03-21 19:52:40 [DEBUG   ] Got command RPT from MCS: ref #94695
2019-03-21 19:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94695  77 58563 71560839 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:52:48 [DEBUG   ] Got command BAM from MCS: ref #94712
2019-03-21 19:52:48 [INFO    ] Finished processing BAM request
2019-03-21 19:52:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:52:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94712   8 58563 71568035 A  ERROR'
2019-03-21 19:52:48 [DEBUG   ] Got command BAM from MCS: ref #94711
2019-03-21 19:52:48 [INFO    ] Finished processing BAM request
2019-03-21 19:52:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:52:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94711   8 58563 71568039 A  ERROR'
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:52:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:52:48 [DEBUG   ] spawn_process: at 2019-03-21 19:52:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:52:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:53:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:53:17 [DEBUG   ] Got command BAM from MCS: ref #94714
2019-03-21 19:53:17 [INFO    ] Finished processing BAM request
2019-03-21 19:53:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94714   8 58563 71597031 A  ERROR'
2019-03-21 19:53:17 [DEBUG   ] Got command BAM from MCS: ref #94713
2019-03-21 19:53:17 [INFO    ] Finished processing BAM request
2019-03-21 19:53:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94713   8 58563 71597035 A  ERROR'
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:53:17 [DEBUG   ] spawn_process: at 2019-03-21 19:53:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:53:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:53:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:53:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:53:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:53:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:53:21 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-03-21 19:53:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:53:46 [DEBUG   ] Got command BAM from MCS: ref #94715
2019-03-21 19:53:46 [INFO    ] Finished processing BAM request
2019-03-21 19:53:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:53:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94715   8 58563 71626023 A  ERROR'
2019-03-21 19:53:46 [DEBUG   ] Got command BAM from MCS: ref #94716
2019-03-21 19:53:46 [INFO    ] Finished processing BAM request
2019-03-21 19:53:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:53:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94716   8 58563 71626027 A  ERROR'
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:53:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:53:46 [DEBUG   ] spawn_process: at 2019-03-21 19:53:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:53:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:54:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:54:15 [DEBUG   ] Got command BAM from MCS: ref #94724
2019-03-21 19:54:15 [INFO    ] Finished processing BAM request
2019-03-21 19:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94724   8 58563 71655031 A  ERROR'
2019-03-21 19:54:15 [DEBUG   ] Got command BAM from MCS: ref #94723
2019-03-21 19:54:15 [INFO    ] Finished processing BAM request
2019-03-21 19:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94723   8 58563 71655035 A  ERROR'
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:54:15 [DEBUG   ] spawn_process: at 2019-03-21 19:54:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:54:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 19:54:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 19:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:54:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:54:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:54:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:54:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:54:21 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-03-21 19:54:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:54:44 [DEBUG   ] Got command BAM from MCS: ref #94726
2019-03-21 19:54:44 [INFO    ] Finished processing BAM request
2019-03-21 19:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94726   8 58563 71684031 A  ERROR'
2019-03-21 19:54:44 [DEBUG   ] Got command BAM from MCS: ref #94725
2019-03-21 19:54:44 [INFO    ] Finished processing BAM request
2019-03-21 19:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94725   8 58563 71684035 A  ERROR'
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:54:44 [DEBUG   ] spawn_process: at 2019-03-21 19:54:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:54:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:55:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:55:13 [DEBUG   ] Got command BAM from MCS: ref #94727
2019-03-21 19:55:13 [INFO    ] Finished processing BAM request
2019-03-21 19:55:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94727   8 58563 71713027 A  ERROR'
2019-03-21 19:55:13 [DEBUG   ] Got command BAM from MCS: ref #94728
2019-03-21 19:55:13 [INFO    ] Finished processing BAM request
2019-03-21 19:55:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94728   8 58563 71713031 A  ERROR'
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:55:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:55:13 [DEBUG   ] spawn_process: at 2019-03-21 19:55:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:55:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:55:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:55:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:55:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:55:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:55:21 [DEBUG   ] Finished updating board flags in 1.041 seconds
2019-03-21 19:55:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:55:42 [DEBUG   ] Got command BAM from MCS: ref #94730
2019-03-21 19:55:42 [INFO    ] Finished processing BAM request
2019-03-21 19:55:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:55:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94730   8 58563 71742027 A  ERROR'
2019-03-21 19:55:42 [DEBUG   ] Got command BAM from MCS: ref #94729
2019-03-21 19:55:42 [INFO    ] Finished processing BAM request
2019-03-21 19:55:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:55:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94729   8 58563 71742031 A  ERROR'
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:55:42 [DEBUG   ] spawn_process: at 2019-03-21 19:55:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:55:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 19:56:11 [DEBUG   ] Got command BAM from MCS: ref #94731
2019-03-21 19:56:11 [INFO    ] Finished processing BAM request
2019-03-21 19:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94731   8 58563 71771031 A  ERROR'
2019-03-21 19:56:11 [DEBUG   ] Got command BAM from MCS: ref #94732
2019-03-21 19:56:11 [INFO    ] Finished processing BAM request
2019-03-21 19:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94732   8 58563 71771035 A  ERROR'
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:56:11 [DEBUG   ] spawn_process: at 2019-03-21 19:56:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:56:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 19:56:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:56:22 [WARNING ] (13, 1, 'bot')
2019-03-21 19:56:22 [WARNING ] (13, 1, 'bot')
2019-03-21 19:56:22 [WARNING ] (13, 1, 'bot')
2019-03-21 19:56:22 [WARNING ] (13, 1, 'bot')
2019-03-21 19:56:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:56:22 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-03-21 19:56:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 19:56:40 [DEBUG   ] Got command BAM from MCS: ref #94733
2019-03-21 19:56:40 [INFO    ] Finished processing BAM request
2019-03-21 19:56:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94733   8 58563 71800023 A  ERROR'
2019-03-21 19:56:40 [DEBUG   ] Got command BAM from MCS: ref #94734
2019-03-21 19:56:40 [INFO    ] Finished processing BAM request
2019-03-21 19:56:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94734   8 58563 71800027 A  ERROR'
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:56:40 [DEBUG   ] spawn_process: at 2019-03-21 19:56:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:56:45 [DEBUG   ] Got command RPT from MCS: ref #94737
2019-03-21 19:56:45 [DEBUG   ] summary = ERROR
2019-03-21 19:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94737  13 58563 71805199 A  ERRORERROR'
2019-03-21 19:56:45 [DEBUG   ] Got command RPT from MCS: ref #94738
2019-03-21 19:56:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94738  77 58563 71805391 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:56:45 [DEBUG   ] Got command RPT from MCS: ref #94739
2019-03-21 19:56:45 [DEBUG   ] summary = ERROR
2019-03-21 19:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94739  13 58563 71805595 A  ERRORERROR'
2019-03-21 19:56:45 [DEBUG   ] Got command RPT from MCS: ref #94741
2019-03-21 19:56:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94741  77 58563 71805799 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:56:46 [DEBUG   ] Got command RPT from MCS: ref #94742
2019-03-21 19:56:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 19:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94742  12 58563 71806003 A  ERRORB›™š'
2019-03-21 19:56:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:57:09 [DEBUG   ] Got command BAM from MCS: ref #94754
2019-03-21 19:57:09 [INFO    ] Finished processing BAM request
2019-03-21 19:57:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94754   8 58563 71829027 A  ERROR'
2019-03-21 19:57:09 [DEBUG   ] Got command BAM from MCS: ref #94753
2019-03-21 19:57:09 [INFO    ] Finished processing BAM request
2019-03-21 19:57:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94753   8 58563 71829031 A  ERROR'
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 19:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 19:57:09 [DEBUG   ] spawn_process: at 2019-03-21 19:57:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 19:57:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 19:57:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:57:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:57:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:57:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:57:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:57:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:57:21 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-03-21 19:57:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 19:57:38 [DEBUG   ] Got command BAM from MCS: ref #94756
2019-03-21 19:57:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94756   8 58563 71858031 A  ERROR'
2019-03-21 19:57:38 [DEBUG   ] Got command BAM from MCS: ref #94755
2019-03-21 19:57:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94755   8 58563 71858035 A  ERROR'
2019-03-21 19:57:38 [INFO    ] Finished processing BAM request
2019-03-21 19:57:38 [INFO    ] Finished processing BAM request
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 19:57:38 [DEBUG   ] spawn_process: at 2019-03-21 19:57:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 19:57:40 [DEBUG   ] Got command RPT from MCS: ref #94757
2019-03-21 19:57:40 [DEBUG   ] summary = ERROR
2019-03-21 19:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94757  13 58563 71860843 A  ERRORERROR'
2019-03-21 19:57:40 [DEBUG   ] Got command RPT from MCS: ref #94758
2019-03-21 19:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 19:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94758  77 58563 71860843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 19:57:52 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 19:58:07 [DEBUG   ] Got command BAM from MCS: ref #94775
2019-03-21 19:58:07 [INFO    ] Finished processing BAM request
2019-03-21 19:58:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94775   8 58563 71887027 A  ERROR'
2019-03-21 19:58:07 [DEBUG   ] Got command BAM from MCS: ref #94774
2019-03-21 19:58:07 [INFO    ] Finished processing BAM request
2019-03-21 19:58:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94774   8 58563 71887031 A  ERROR'
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:58:07 [DEBUG   ] spawn_process: at 2019-03-21 19:58:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:58:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 19:58:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:58:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 19:58:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:58:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:58:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:58:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:58:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:58:21 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-03-21 19:58:32 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 19:58:36 [DEBUG   ] Got command BAM from MCS: ref #94777
2019-03-21 19:58:36 [INFO    ] Finished processing BAM request
2019-03-21 19:58:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94777   8 58563 71916035 A  ERROR'
2019-03-21 19:58:36 [DEBUG   ] Got command BAM from MCS: ref #94776
2019-03-21 19:58:36 [INFO    ] Finished processing BAM request
2019-03-21 19:58:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94776   8 58563 71916039 A  ERROR'
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:58:36 [DEBUG   ] spawn_process: at 2019-03-21 19:58:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:58:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:59:05 [DEBUG   ] Got command BAM from MCS: ref #94779
2019-03-21 19:59:05 [INFO    ] Finished processing BAM request
2019-03-21 19:59:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94779   8 58563 71945023 A  ERROR'
2019-03-21 19:59:05 [DEBUG   ] Got command BAM from MCS: ref #94778
2019-03-21 19:59:05 [INFO    ] Finished processing BAM request
2019-03-21 19:59:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:59:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94778   8 58563 71945027 A  ERROR'
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 19:59:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 19:59:05 [DEBUG   ] spawn_process: at 2019-03-21 19:59:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 19:59:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:59:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 19:59:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:59:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:59:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:59:21 [WARNING ] (13, 1, 'bot')
2019-03-21 19:59:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 19:59:21 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-03-21 19:59:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 19:59:34 [DEBUG   ] Got command BAM from MCS: ref #94780
2019-03-21 19:59:34 [INFO    ] Finished processing BAM request
2019-03-21 19:59:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94780   8 58563 71974035 A  ERROR'
2019-03-21 19:59:34 [DEBUG   ] Got command BAM from MCS: ref #94781
2019-03-21 19:59:34 [INFO    ] Finished processing BAM request
2019-03-21 19:59:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 19:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94781   8 58563 71974039 A  ERROR'
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 19:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 19:59:34 [DEBUG   ] spawn_process: at 2019-03-21 19:59:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 19:59:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 20:00:03 [DEBUG   ] Got command BAM from MCS: ref #94789
2019-03-21 20:00:03 [INFO    ] Finished processing BAM request
2019-03-21 20:00:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94789   8 58563 72003035 A  ERROR'
2019-03-21 20:00:03 [DEBUG   ] Got command BAM from MCS: ref #94788
2019-03-21 20:00:03 [INFO    ] Finished processing BAM request
2019-03-21 20:00:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94788   8 58563 72003039 A  ERROR'
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:00:03 [DEBUG   ] spawn_process: at 2019-03-21 20:00:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:00:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 20:00:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:00:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:00:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:00:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:00:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:00:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:00:21 [DEBUG   ] Finished updating board flags in 1.236 seconds
2019-03-21 20:00:32 [DEBUG   ] Got command BAM from MCS: ref #94791
2019-03-21 20:00:32 [INFO    ] Finished processing BAM request
2019-03-21 20:00:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94791   8 58563 72032031 A  ERROR'
2019-03-21 20:00:32 [DEBUG   ] Got command BAM from MCS: ref #94790
2019-03-21 20:00:32 [INFO    ] Finished processing BAM request
2019-03-21 20:00:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94790   8 58563 72032035 A  ERROR'
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:00:32 [DEBUG   ] spawn_process: at 2019-03-21 20:00:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:00:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 20:00:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 20:01:01 [DEBUG   ] Got command BAM from MCS: ref #94793
2019-03-21 20:01:01 [INFO    ] Finished processing BAM request
2019-03-21 20:01:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94793   8 58563 72061031 A  ERROR'
2019-03-21 20:01:01 [DEBUG   ] Got command BAM from MCS: ref #94792
2019-03-21 20:01:01 [INFO    ] Finished processing BAM request
2019-03-21 20:01:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94792   8 58563 72061035 A  ERROR'
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:01:01 [DEBUG   ] spawn_process: at 2019-03-21 20:01:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:01:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 20:01:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:01:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:01:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:01:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:01:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:01:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:01:21 [DEBUG   ] Finished updating board flags in 1.173 seconds
2019-03-21 20:01:30 [DEBUG   ] Got command BAM from MCS: ref #94794
2019-03-21 20:01:30 [INFO    ] Finished processing BAM request
2019-03-21 20:01:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94794   8 58563 72090031 A  ERROR'
2019-03-21 20:01:30 [DEBUG   ] Got command BAM from MCS: ref #94795
2019-03-21 20:01:30 [INFO    ] Finished processing BAM request
2019-03-21 20:01:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94795   8 58563 72090035 A  ERROR'
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:01:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:01:30 [DEBUG   ] spawn_process: at 2019-03-21 20:01:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:01:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 20:01:45 [DEBUG   ] Got command RPT from MCS: ref #94796
2019-03-21 20:01:45 [DEBUG   ] summary = ERROR
2019-03-21 20:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94796  13 58563 72105287 A  ERRORERROR'
2019-03-21 20:01:45 [DEBUG   ] Got command RPT from MCS: ref #94797
2019-03-21 20:01:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94797  77 58563 72105479 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:01:45 [DEBUG   ] Got command RPT from MCS: ref #94798
2019-03-21 20:01:45 [DEBUG   ] summary = ERROR
2019-03-21 20:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94798  13 58563 72105687 A  ERRORERROR'
2019-03-21 20:01:45 [DEBUG   ] Got command RPT from MCS: ref #94799
2019-03-21 20:01:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94799  77 58563 72105879 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:01:46 [DEBUG   ] Got command RPT from MCS: ref #94800
2019-03-21 20:01:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94800  12 58563 72106083 A  ERRORB›™š'
2019-03-21 20:01:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:01:59 [DEBUG   ] Got command BAM from MCS: ref #94801
2019-03-21 20:01:59 [INFO    ] Finished processing BAM request
2019-03-21 20:01:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94801   8 58563 72119023 A  ERROR'
2019-03-21 20:01:59 [DEBUG   ] Got command BAM from MCS: ref #94802
2019-03-21 20:01:59 [INFO    ] Finished processing BAM request
2019-03-21 20:01:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94802   8 58563 72119027 A  ERROR'
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:01:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:01:59 [DEBUG   ] spawn_process: at 2019-03-21 20:01:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:02:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:02:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:02:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:02:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:02:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:02:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:02:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:02:21 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-03-21 20:02:28 [DEBUG   ] Got command BAM from MCS: ref #94804
2019-03-21 20:02:28 [INFO    ] Finished processing BAM request
2019-03-21 20:02:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94804   8 58563 72148023 A  ERROR'
2019-03-21 20:02:28 [DEBUG   ] Got command BAM from MCS: ref #94803
2019-03-21 20:02:28 [INFO    ] Finished processing BAM request
2019-03-21 20:02:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94803   8 58563 72148027 A  ERROR'
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:02:28 [DEBUG   ] spawn_process: at 2019-03-21 20:02:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:02:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 20:02:40 [DEBUG   ] Got command RPT from MCS: ref #94805
2019-03-21 20:02:40 [DEBUG   ] summary = ERROR
2019-03-21 20:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94805  13 58563 72160851 A  ERRORERROR'
2019-03-21 20:02:40 [DEBUG   ] Got command RPT from MCS: ref #94806
2019-03-21 20:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94806  77 58563 72160851 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:02:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 20:02:57 [DEBUG   ] Got command BAM from MCS: ref #94829
2019-03-21 20:02:57 [INFO    ] Finished processing BAM request
2019-03-21 20:02:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:02:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94829   8 58563 72177031 A  ERROR'
2019-03-21 20:02:57 [DEBUG   ] Got command BAM from MCS: ref #94828
2019-03-21 20:02:57 [INFO    ] Finished processing BAM request
2019-03-21 20:02:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:02:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94828   8 58563 72177035 A  ERROR'
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:02:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:02:57 [DEBUG   ] spawn_process: at 2019-03-21 20:02:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:03:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 20:03:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:03:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:03:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:03:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:03:21 [WARNING ] (13, 1, 'bot')
2019-03-21 20:03:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:03:21 [DEBUG   ] Finished updating board flags in 0.980 seconds
2019-03-21 20:03:26 [DEBUG   ] Got command BAM from MCS: ref #94830
2019-03-21 20:03:26 [INFO    ] Finished processing BAM request
2019-03-21 20:03:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94830   8 58563 72206027 A  ERROR'
2019-03-21 20:03:26 [DEBUG   ] Got command BAM from MCS: ref #94831
2019-03-21 20:03:26 [INFO    ] Finished processing BAM request
2019-03-21 20:03:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94831   8 58563 72206031 A  ERROR'
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:03:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:03:26 [DEBUG   ] spawn_process: at 2019-03-21 20:03:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:03:34 [DEBUG   ] Finished updating ant stats in 1.804 seconds
2019-03-21 20:03:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:03:55 [DEBUG   ] Got command BAM from MCS: ref #94833
2019-03-21 20:03:55 [INFO    ] Finished processing BAM request
2019-03-21 20:03:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94833   8 58563 72235027 A  ERROR'
2019-03-21 20:03:55 [DEBUG   ] Got command BAM from MCS: ref #94832
2019-03-21 20:03:55 [INFO    ] Finished processing BAM request
2019-03-21 20:03:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94832   8 58563 72235031 A  ERROR'
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:03:55 [DEBUG   ] spawn_process: at 2019-03-21 20:03:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:04:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:04:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:04:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:04:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:04:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:04:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:04:22 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-03-21 20:04:25 [DEBUG   ] Got command BAM from MCS: ref #94835
2019-03-21 20:04:25 [INFO    ] Finished processing BAM request
2019-03-21 20:04:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94835   8 58563 72265027 A  ERROR'
2019-03-21 20:04:25 [DEBUG   ] Got command BAM from MCS: ref #94834
2019-03-21 20:04:25 [INFO    ] Finished processing BAM request
2019-03-21 20:04:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94834   8 58563 72265031 A  ERROR'
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:04:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:04:25 [DEBUG   ] spawn_process: at 2019-03-21 20:04:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:04:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:04:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 20:04:55 [DEBUG   ] Got command BAM from MCS: ref #94837
2019-03-21 20:04:55 [INFO    ] Finished processing BAM request
2019-03-21 20:04:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94837   8 58563 72295027 A  ERROR'
2019-03-21 20:04:55 [DEBUG   ] Got command BAM from MCS: ref #94836
2019-03-21 20:04:55 [INFO    ] Finished processing BAM request
2019-03-21 20:04:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94836   8 58563 72295031 A  ERROR'
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:04:55 [DEBUG   ] spawn_process: at 2019-03-21 20:04:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:05:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 20:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:05:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:05:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:05:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:05:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:05:22 [DEBUG   ] Finished updating board flags in 1.245 seconds
2019-03-21 20:05:25 [DEBUG   ] Got command BAM from MCS: ref #94838
2019-03-21 20:05:25 [INFO    ] Finished processing BAM request
2019-03-21 20:05:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94838   8 58563 72325027 A  ERROR'
2019-03-21 20:05:25 [DEBUG   ] Got command BAM from MCS: ref #94839
2019-03-21 20:05:25 [INFO    ] Finished processing BAM request
2019-03-21 20:05:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94839   8 58563 72325031 A  ERROR'
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:05:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:05:25 [DEBUG   ] spawn_process: at 2019-03-21 20:05:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:05:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:05:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:05:55 [DEBUG   ] Got command BAM from MCS: ref #94846
2019-03-21 20:05:55 [INFO    ] Finished processing BAM request
2019-03-21 20:05:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:05:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94846   8 58563 72355035 A  ERROR'
2019-03-21 20:05:55 [DEBUG   ] Got command BAM from MCS: ref #94847
2019-03-21 20:05:55 [INFO    ] Finished processing BAM request
2019-03-21 20:05:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:05:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94847   8 58563 72355039 A  ERROR'
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:05:55 [DEBUG   ] spawn_process: at 2019-03-21 20:05:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:06:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:06:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:06:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:06:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:06:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:06:22 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-03-21 20:06:25 [DEBUG   ] Got command BAM from MCS: ref #94848
2019-03-21 20:06:25 [INFO    ] Finished processing BAM request
2019-03-21 20:06:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94848   8 58563 72385035 A  ERROR'
2019-03-21 20:06:25 [DEBUG   ] Got command BAM from MCS: ref #94849
2019-03-21 20:06:25 [INFO    ] Finished processing BAM request
2019-03-21 20:06:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94849   8 58563 72385039 A  ERROR'
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:06:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:06:25 [DEBUG   ] spawn_process: at 2019-03-21 20:06:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:06:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:06:45 [DEBUG   ] Got command RPT from MCS: ref #94852
2019-03-21 20:06:45 [DEBUG   ] summary = ERROR
2019-03-21 20:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94852  13 58563 72405367 A  ERRORERROR'
2019-03-21 20:06:45 [DEBUG   ] Got command RPT from MCS: ref #94853
2019-03-21 20:06:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94853  77 58563 72405571 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:06:45 [DEBUG   ] Got command RPT from MCS: ref #94854
2019-03-21 20:06:45 [DEBUG   ] summary = ERROR
2019-03-21 20:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94854  13 58563 72405775 A  ERRORERROR'
2019-03-21 20:06:45 [DEBUG   ] Got command RPT from MCS: ref #94856
2019-03-21 20:06:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94856  77 58563 72405967 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:06:46 [DEBUG   ] Got command RPT from MCS: ref #94857
2019-03-21 20:06:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94857  12 58563 72406171 A  ERRORB›™š'
2019-03-21 20:06:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:06:55 [DEBUG   ] Got command BAM from MCS: ref #94862
2019-03-21 20:06:55 [INFO    ] Finished processing BAM request
2019-03-21 20:06:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94862   8 58563 72415035 A  ERROR'
2019-03-21 20:06:55 [DEBUG   ] Got command BAM from MCS: ref #94863
2019-03-21 20:06:55 [INFO    ] Finished processing BAM request
2019-03-21 20:06:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94863   8 58563 72415039 A  ERROR'
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:06:55 [DEBUG   ] spawn_process: at 2019-03-21 20:06:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:07:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:07:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:07:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:07:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:07:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:07:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:07:22 [DEBUG   ] Finished updating board flags in 1.173 seconds
2019-03-21 20:07:25 [DEBUG   ] Got command BAM from MCS: ref #94865
2019-03-21 20:07:25 [INFO    ] Finished processing BAM request
2019-03-21 20:07:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94865   8 58563 72445035 A  ERROR'
2019-03-21 20:07:25 [DEBUG   ] Got command BAM from MCS: ref #94864
2019-03-21 20:07:25 [INFO    ] Finished processing BAM request
2019-03-21 20:07:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94864   8 58563 72445039 A  ERROR'
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:07:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:07:25 [DEBUG   ] spawn_process: at 2019-03-21 20:07:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:07:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 20:07:40 [DEBUG   ] Got command RPT from MCS: ref #94866
2019-03-21 20:07:40 [DEBUG   ] summary = ERROR
2019-03-21 20:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94866  13 58563 72460851 A  ERRORERROR'
2019-03-21 20:07:40 [DEBUG   ] Got command RPT from MCS: ref #94867
2019-03-21 20:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94867  77 58563 72460851 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:07:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:07:55 [DEBUG   ] Got command BAM from MCS: ref #94884
2019-03-21 20:07:55 [INFO    ] Finished processing BAM request
2019-03-21 20:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94884   8 58563 72475031 A  ERROR'
2019-03-21 20:07:55 [DEBUG   ] Got command BAM from MCS: ref #94883
2019-03-21 20:07:55 [INFO    ] Finished processing BAM request
2019-03-21 20:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94883   8 58563 72475035 A  ERROR'
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:07:55 [DEBUG   ] spawn_process: at 2019-03-21 20:07:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:08:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:08:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:08:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:08:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:08:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:08:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:08:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:08:23 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-03-21 20:08:25 [DEBUG   ] Got command BAM from MCS: ref #94886
2019-03-21 20:08:25 [INFO    ] Finished processing BAM request
2019-03-21 20:08:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94886   8 58563 72505027 A  ERROR'
2019-03-21 20:08:25 [DEBUG   ] Got command BAM from MCS: ref #94885
2019-03-21 20:08:25 [INFO    ] Finished processing BAM request
2019-03-21 20:08:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94885   8 58563 72505031 A  ERROR'
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:08:25 [DEBUG   ] spawn_process: at 2019-03-21 20:08:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:08:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:08:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:08:55 [DEBUG   ] Got command BAM from MCS: ref #94894
2019-03-21 20:08:55 [INFO    ] Finished processing BAM request
2019-03-21 20:08:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94894   8 58563 72535031 A  ERROR'
2019-03-21 20:08:55 [DEBUG   ] Got command BAM from MCS: ref #94893
2019-03-21 20:08:55 [INFO    ] Finished processing BAM request
2019-03-21 20:08:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94893   8 58563 72535035 A  ERROR'
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:08:55 [DEBUG   ] spawn_process: at 2019-03-21 20:08:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:09:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:09:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:09:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:09:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:09:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:09:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:09:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:09:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:09:22 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-03-21 20:09:25 [DEBUG   ] Got command BAM from MCS: ref #94896
2019-03-21 20:09:25 [INFO    ] Finished processing BAM request
2019-03-21 20:09:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:09:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94896   8 58563 72565027 A  ERROR'
2019-03-21 20:09:25 [DEBUG   ] Got command BAM from MCS: ref #94895
2019-03-21 20:09:25 [INFO    ] Finished processing BAM request
2019-03-21 20:09:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:09:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94895   8 58563 72565031 A  ERROR'
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:09:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:09:25 [DEBUG   ] spawn_process: at 2019-03-21 20:09:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:09:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:09:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:09:55 [DEBUG   ] Got command BAM from MCS: ref #94898
2019-03-21 20:09:55 [INFO    ] Finished processing BAM request
2019-03-21 20:09:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94898   8 58563 72595035 A  ERROR'
2019-03-21 20:09:55 [DEBUG   ] Got command BAM from MCS: ref #94897
2019-03-21 20:09:55 [INFO    ] Finished processing BAM request
2019-03-21 20:09:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94897   8 58563 72595039 A  ERROR'
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:09:55 [DEBUG   ] spawn_process: at 2019-03-21 20:09:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:10:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 20:10:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 20:10:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:10:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:10:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:10:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:10:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:10:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:10:22 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-03-21 20:10:25 [DEBUG   ] Got command BAM from MCS: ref #94900
2019-03-21 20:10:25 [INFO    ] Finished processing BAM request
2019-03-21 20:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94900   8 58563 72625027 A  ERROR'
2019-03-21 20:10:25 [DEBUG   ] Got command BAM from MCS: ref #94899
2019-03-21 20:10:25 [INFO    ] Finished processing BAM request
2019-03-21 20:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94899   8 58563 72625031 A  ERROR'
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:10:25 [DEBUG   ] spawn_process: at 2019-03-21 20:10:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:10:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:10:53 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 20:10:55 [DEBUG   ] Got command BAM from MCS: ref #94902
2019-03-21 20:10:55 [INFO    ] Finished processing BAM request
2019-03-21 20:10:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:10:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94902   8 58563 72655035 A  ERROR'
2019-03-21 20:10:55 [DEBUG   ] Got command BAM from MCS: ref #94901
2019-03-21 20:10:55 [INFO    ] Finished processing BAM request
2019-03-21 20:10:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:10:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94901   8 58563 72655039 A  ERROR'
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:10:55 [DEBUG   ] spawn_process: at 2019-03-21 20:10:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:11:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 20:11:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:11:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:11:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:11:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:11:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:11:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:11:22 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-03-21 20:11:25 [DEBUG   ] Got command BAM from MCS: ref #94903
2019-03-21 20:11:25 [INFO    ] Finished processing BAM request
2019-03-21 20:11:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:11:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94903   8 58563 72685035 A  ERROR'
2019-03-21 20:11:25 [DEBUG   ] Got command BAM from MCS: ref #94904
2019-03-21 20:11:25 [INFO    ] Finished processing BAM request
2019-03-21 20:11:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:11:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94904   8 58563 72685039 A  ERROR'
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:11:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:11:25 [DEBUG   ] spawn_process: at 2019-03-21 20:11:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:11:34 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2019-03-21 20:11:45 [DEBUG   ] Got command RPT from MCS: ref #94905
2019-03-21 20:11:45 [DEBUG   ] summary = ERROR
2019-03-21 20:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94905  13 58563 72705455 A  ERRORERROR'
2019-03-21 20:11:45 [DEBUG   ] Got command RPT from MCS: ref #94906
2019-03-21 20:11:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94906  77 58563 72705659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:11:45 [DEBUG   ] Got command RPT from MCS: ref #94907
2019-03-21 20:11:45 [DEBUG   ] summary = ERROR
2019-03-21 20:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94907  13 58563 72705863 A  ERRORERROR'
2019-03-21 20:11:46 [DEBUG   ] Got command RPT from MCS: ref #94908
2019-03-21 20:11:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94908  77 58563 72706055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:11:46 [DEBUG   ] Got command RPT from MCS: ref #94909
2019-03-21 20:11:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94909  12 58563 72706259 A  ERRORBš™š'
2019-03-21 20:11:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:11:55 [DEBUG   ] Got command BAM from MCS: ref #94916
2019-03-21 20:11:55 [INFO    ] Finished processing BAM request
2019-03-21 20:11:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94916   8 58563 72715027 A  ERROR'
2019-03-21 20:11:55 [DEBUG   ] Got command BAM from MCS: ref #94917
2019-03-21 20:11:55 [INFO    ] Finished processing BAM request
2019-03-21 20:11:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94917   8 58563 72715031 A  ERROR'
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:11:55 [DEBUG   ] spawn_process: at 2019-03-21 20:11:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:12:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:12:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:12:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:12:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:12:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:12:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:12:22 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-03-21 20:12:25 [DEBUG   ] Got command BAM from MCS: ref #94918
2019-03-21 20:12:25 [INFO    ] Finished processing BAM request
2019-03-21 20:12:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94918   8 58563 72745027 A  ERROR'
2019-03-21 20:12:25 [DEBUG   ] Got command BAM from MCS: ref #94919
2019-03-21 20:12:25 [INFO    ] Finished processing BAM request
2019-03-21 20:12:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94919   8 58563 72745031 A  ERROR'
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:12:25 [DEBUG   ] spawn_process: at 2019-03-21 20:12:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:12:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 20:12:40 [DEBUG   ] Got command RPT from MCS: ref #94920
2019-03-21 20:12:40 [DEBUG   ] summary = ERROR
2019-03-21 20:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94920  13 58563 72760847 A  ERRORERROR'
2019-03-21 20:12:40 [DEBUG   ] Got command RPT from MCS: ref #94921
2019-03-21 20:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94921  77 58563 72760847 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:12:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 20:12:55 [DEBUG   ] Got command BAM from MCS: ref #94937
2019-03-21 20:12:55 [INFO    ] Finished processing BAM request
2019-03-21 20:12:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:12:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94937   8 58563 72775035 A  ERROR'
2019-03-21 20:12:55 [DEBUG   ] Got command BAM from MCS: ref #94938
2019-03-21 20:12:55 [INFO    ] Finished processing BAM request
2019-03-21 20:12:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:12:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94938   8 58563 72775039 A  ERROR'
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:12:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:12:55 [DEBUG   ] spawn_process: at 2019-03-21 20:12:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:13:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:13:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:13:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:13:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:13:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:13:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:13:22 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-03-21 20:13:26 [DEBUG   ] Got command BAM from MCS: ref #94939
2019-03-21 20:13:26 [INFO    ] Finished processing BAM request
2019-03-21 20:13:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94939   8 58563 72806035 A  ERROR'
2019-03-21 20:13:26 [DEBUG   ] Got command BAM from MCS: ref #94940
2019-03-21 20:13:26 [INFO    ] Finished processing BAM request
2019-03-21 20:13:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94940   8 58563 72806039 A  ERROR'
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:13:26 [DEBUG   ] spawn_process: at 2019-03-21 20:13:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:13:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 20:13:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:13:57 [DEBUG   ] Got command BAM from MCS: ref #94941
2019-03-21 20:13:57 [INFO    ] Finished processing BAM request
2019-03-21 20:13:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94941   8 58563 72837035 A  ERROR'
2019-03-21 20:13:57 [DEBUG   ] Got command BAM from MCS: ref #94942
2019-03-21 20:13:57 [INFO    ] Finished processing BAM request
2019-03-21 20:13:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94942   8 58563 72837039 A  ERROR'
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:13:57 [DEBUG   ] spawn_process: at 2019-03-21 20:13:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:14:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:14:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:14:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:14:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:14:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:14:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:14:22 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-03-21 20:14:28 [DEBUG   ] Got command BAM from MCS: ref #94944
2019-03-21 20:14:28 [INFO    ] Finished processing BAM request
2019-03-21 20:14:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94944   8 58563 72868027 A  ERROR'
2019-03-21 20:14:28 [DEBUG   ] Got command BAM from MCS: ref #94943
2019-03-21 20:14:28 [INFO    ] Finished processing BAM request
2019-03-21 20:14:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94943   8 58563 72868031 A  ERROR'
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:14:28 [DEBUG   ] spawn_process: at 2019-03-21 20:14:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:14:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:14:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:14:59 [DEBUG   ] Got command BAM from MCS: ref #94952
2019-03-21 20:14:59 [INFO    ] Finished processing BAM request
2019-03-21 20:14:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94952   8 58563 72899031 A  ERROR'
2019-03-21 20:14:59 [DEBUG   ] Got command BAM from MCS: ref #94951
2019-03-21 20:14:59 [INFO    ] Finished processing BAM request
2019-03-21 20:14:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94951   8 58563 72899035 A  ERROR'
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:14:59 [DEBUG   ] spawn_process: at 2019-03-21 20:14:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:15:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:15:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 20:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:15:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:15:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:15:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:15:22 [WARNING ] (13, 1, 'bot')
2019-03-21 20:15:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:15:22 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-03-21 20:15:30 [DEBUG   ] Got command BAM from MCS: ref #94954
2019-03-21 20:15:30 [INFO    ] Finished processing BAM request
2019-03-21 20:15:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94954   8 58563 72930027 A  ERROR'
2019-03-21 20:15:30 [DEBUG   ] Got command BAM from MCS: ref #94953
2019-03-21 20:15:30 [INFO    ] Finished processing BAM request
2019-03-21 20:15:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94953   8 58563 72930031 A  ERROR'
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:15:30 [DEBUG   ] spawn_process: at 2019-03-21 20:15:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:15:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 20:15:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:16:01 [DEBUG   ] Got command BAM from MCS: ref #94955
2019-03-21 20:16:01 [INFO    ] Finished processing BAM request
2019-03-21 20:16:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94955   8 58563 72961035 A  ERROR'
2019-03-21 20:16:01 [DEBUG   ] Got command BAM from MCS: ref #94956
2019-03-21 20:16:01 [INFO    ] Finished processing BAM request
2019-03-21 20:16:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94956   8 58563 72961039 A  ERROR'
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:16:01 [DEBUG   ] spawn_process: at 2019-03-21 20:16:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:16:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 20:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:16:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:16:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:16:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:16:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:16:23 [DEBUG   ] Finished updating board flags in 1.556 seconds
2019-03-21 20:16:32 [DEBUG   ] Got command BAM from MCS: ref #94958
2019-03-21 20:16:32 [INFO    ] Finished processing BAM request
2019-03-21 20:16:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:16:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94958   8 58563 72992027 A  ERROR'
2019-03-21 20:16:32 [DEBUG   ] Got command BAM from MCS: ref #94957
2019-03-21 20:16:32 [INFO    ] Finished processing BAM request
2019-03-21 20:16:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:16:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94957   8 58563 72992031 A  ERROR'
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:16:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:16:32 [DEBUG   ] spawn_process: at 2019-03-21 20:16:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:16:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:16:45 [DEBUG   ] Got command RPT from MCS: ref #94961
2019-03-21 20:16:45 [DEBUG   ] summary = ERROR
2019-03-21 20:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94961  13 58563 73005543 A  ERRORERROR'
2019-03-21 20:16:45 [DEBUG   ] Got command RPT from MCS: ref #94962
2019-03-21 20:16:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94962  77 58563 73005735 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:16:45 [DEBUG   ] Got command RPT from MCS: ref #94963
2019-03-21 20:16:45 [DEBUG   ] summary = ERROR
2019-03-21 20:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94963  13 58563 73005939 A  ERRORERROR'
2019-03-21 20:16:46 [DEBUG   ] Got command RPT from MCS: ref #94965
2019-03-21 20:16:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94965  77 58563 73006143 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:16:46 [DEBUG   ] Got command RPT from MCS: ref #94966
2019-03-21 20:16:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94966  12 58563 73006347 A  ERRORBš™š'
2019-03-21 20:16:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:17:03 [DEBUG   ] Got command BAM from MCS: ref #94971
2019-03-21 20:17:03 [INFO    ] Finished processing BAM request
2019-03-21 20:17:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:17:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94971   8 58563 73023039 A  ERROR'
2019-03-21 20:17:03 [DEBUG   ] Got command BAM from MCS: ref #94972
2019-03-21 20:17:03 [INFO    ] Finished processing BAM request
2019-03-21 20:17:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:17:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94972   8 58563 73023043 A  ERROR'
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:17:03 [DEBUG   ] spawn_process: at 2019-03-21 20:17:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:17:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:17:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:17:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:17:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:17:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:17:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:17:23 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-03-21 20:17:34 [DEBUG   ] Got command BAM from MCS: ref #94973
2019-03-21 20:17:34 [INFO    ] Finished processing BAM request
2019-03-21 20:17:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94973   8 58563 73054031 A  ERROR'
2019-03-21 20:17:34 [DEBUG   ] Got command BAM from MCS: ref #94974
2019-03-21 20:17:34 [INFO    ] Finished processing BAM request
2019-03-21 20:17:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94974   8 58563 73054039 A  ERROR'
2019-03-21 20:17:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:17:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:17:34 [DEBUG   ] spawn_process: at 2019-03-21 20:17:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:17:40 [DEBUG   ] Got command RPT from MCS: ref #94975
2019-03-21 20:17:40 [DEBUG   ] summary = ERROR
2019-03-21 20:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94975  13 58563 73060847 A  ERRORERROR'
2019-03-21 20:17:40 [DEBUG   ] Got command RPT from MCS: ref #94976
2019-03-21 20:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    94976  77 58563 73060847 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:17:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:18:05 [DEBUG   ] Got command BAM from MCS: ref #94998
2019-03-21 20:18:05 [INFO    ] Finished processing BAM request
2019-03-21 20:18:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94998   8 58563 73085027 A  ERROR'
2019-03-21 20:18:05 [DEBUG   ] Got command BAM from MCS: ref #94999
2019-03-21 20:18:05 [INFO    ] Finished processing BAM request
2019-03-21 20:18:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    94999   8 58563 73085031 A  ERROR'
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:18:05 [DEBUG   ] spawn_process: at 2019-03-21 20:18:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:18:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:18:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:18:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:18:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:18:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:18:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:18:23 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-03-21 20:18:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 20:18:36 [DEBUG   ] Got command BAM from MCS: ref #95000
2019-03-21 20:18:36 [INFO    ] Finished processing BAM request
2019-03-21 20:18:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95000   8 58563 73116031 A  ERROR'
2019-03-21 20:18:36 [DEBUG   ] Got command BAM from MCS: ref #95001
2019-03-21 20:18:36 [INFO    ] Finished processing BAM request
2019-03-21 20:18:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95001   8 58563 73116035 A  ERROR'
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:18:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:18:36 [DEBUG   ] spawn_process: at 2019-03-21 20:18:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:18:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:19:07 [DEBUG   ] Got command BAM from MCS: ref #95002
2019-03-21 20:19:07 [INFO    ] Finished processing BAM request
2019-03-21 20:19:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95002   8 58563 73147031 A  ERROR'
2019-03-21 20:19:07 [DEBUG   ] Got command BAM from MCS: ref #95003
2019-03-21 20:19:07 [INFO    ] Finished processing BAM request
2019-03-21 20:19:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95003   8 58563 73147035 A  ERROR'
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:19:07 [DEBUG   ] spawn_process: at 2019-03-21 20:19:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:19:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 20:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:19:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:19:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:19:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:19:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:19:23 [DEBUG   ] Finished updating board flags in 1.199 seconds
2019-03-21 20:19:34 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 20:19:38 [DEBUG   ] Got command BAM from MCS: ref #95005
2019-03-21 20:19:38 [INFO    ] Finished processing BAM request
2019-03-21 20:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95005   8 58563 73178027 A  ERROR'
2019-03-21 20:19:38 [DEBUG   ] Got command BAM from MCS: ref #95004
2019-03-21 20:19:38 [INFO    ] Finished processing BAM request
2019-03-21 20:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95004   8 58563 73178031 A  ERROR'
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:19:38 [DEBUG   ] spawn_process: at 2019-03-21 20:19:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:19:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 20:20:09 [DEBUG   ] Got command BAM from MCS: ref #95007
2019-03-21 20:20:09 [INFO    ] Finished processing BAM request
2019-03-21 20:20:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95007   8 58563 73209031 A  ERROR'
2019-03-21 20:20:09 [DEBUG   ] Got command BAM from MCS: ref #95006
2019-03-21 20:20:09 [INFO    ] Finished processing BAM request
2019-03-21 20:20:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95006   8 58563 73209035 A  ERROR'
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:20:09 [DEBUG   ] spawn_process: at 2019-03-21 20:20:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:20:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 20:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:20:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 20:20:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:20:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:20:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:20:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:20:23 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-03-21 20:20:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:20:40 [DEBUG   ] Got command BAM from MCS: ref #95009
2019-03-21 20:20:40 [INFO    ] Finished processing BAM request
2019-03-21 20:20:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95009   8 58563 73240027 A  ERROR'
2019-03-21 20:20:40 [DEBUG   ] Got command BAM from MCS: ref #95008
2019-03-21 20:20:40 [INFO    ] Finished processing BAM request
2019-03-21 20:20:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95008   8 58563 73240031 A  ERROR'
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:20:40 [DEBUG   ] spawn_process: at 2019-03-21 20:20:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:20:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:21:12 [DEBUG   ] Got command BAM from MCS: ref #95017
2019-03-21 20:21:12 [INFO    ] Finished processing BAM request
2019-03-21 20:21:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95017   8 58563 73272031 A  ERROR'
2019-03-21 20:21:12 [DEBUG   ] Got command BAM from MCS: ref #95016
2019-03-21 20:21:12 [INFO    ] Finished processing BAM request
2019-03-21 20:21:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95016   8 58563 73272035 A  ERROR'
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:21:12 [DEBUG   ] spawn_process: at 2019-03-21 20:21:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:21:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:21:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:21:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:21:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:21:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:21:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:21:24 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-03-21 20:21:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:21:44 [DEBUG   ] Got command BAM from MCS: ref #95018
2019-03-21 20:21:44 [INFO    ] Finished processing BAM request
2019-03-21 20:21:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95018   8 58563 73304035 A  ERROR'
2019-03-21 20:21:44 [DEBUG   ] Got command BAM from MCS: ref #95019
2019-03-21 20:21:44 [INFO    ] Finished processing BAM request
2019-03-21 20:21:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95019   8 58563 73304039 A  ERROR'
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:21:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:21:44 [DEBUG   ] spawn_process: at 2019-03-21 20:21:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:21:45 [DEBUG   ] Got command RPT from MCS: ref #95020
2019-03-21 20:21:45 [DEBUG   ] summary = ERROR
2019-03-21 20:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95020  13 58563 73305623 A  ERRORERROR'
2019-03-21 20:21:45 [DEBUG   ] Got command RPT from MCS: ref #95021
2019-03-21 20:21:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95021  77 58563 73305827 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:21:46 [DEBUG   ] Got command RPT from MCS: ref #95022
2019-03-21 20:21:46 [DEBUG   ] summary = ERROR
2019-03-21 20:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95022  13 58563 73306031 A  ERRORERROR'
2019-03-21 20:21:46 [DEBUG   ] Got command RPT from MCS: ref #95023
2019-03-21 20:21:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95023  77 58563 73306223 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:21:46 [DEBUG   ] Got command RPT from MCS: ref #95024
2019-03-21 20:21:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95024  12 58563 73306427 A  ERRORBœ™š'
2019-03-21 20:21:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:22:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:22:16 [DEBUG   ] Got command BAM from MCS: ref #95025
2019-03-21 20:22:16 [INFO    ] Finished processing BAM request
2019-03-21 20:22:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:22:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95025   8 58563 73336035 A  ERROR'
2019-03-21 20:22:16 [DEBUG   ] Got command BAM from MCS: ref #95026
2019-03-21 20:22:16 [INFO    ] Finished processing BAM request
2019-03-21 20:22:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:22:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95026   8 58563 73336039 A  ERROR'
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:22:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:22:16 [DEBUG   ] spawn_process: at 2019-03-21 20:22:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:22:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:22:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:22:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:22:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:22:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:22:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:22:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:22:23 [DEBUG   ] Finished updating board flags in 1.239 seconds
2019-03-21 20:22:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:22:40 [DEBUG   ] Got command RPT from MCS: ref #95027
2019-03-21 20:22:40 [DEBUG   ] summary = ERROR
2019-03-21 20:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95027  13 58563 73360855 A  ERRORERROR'
2019-03-21 20:22:40 [DEBUG   ] Got command RPT from MCS: ref #95028
2019-03-21 20:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95028  77 58563 73360855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:22:48 [DEBUG   ] Got command BAM from MCS: ref #95045
2019-03-21 20:22:48 [INFO    ] Finished processing BAM request
2019-03-21 20:22:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:22:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95045   8 58563 73368035 A  ERROR'
2019-03-21 20:22:48 [DEBUG   ] Got command BAM from MCS: ref #95044
2019-03-21 20:22:48 [INFO    ] Finished processing BAM request
2019-03-21 20:22:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:22:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95044   8 58563 73368039 A  ERROR'
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:22:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:22:48 [DEBUG   ] spawn_process: at 2019-03-21 20:22:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:22:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:23:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:23:20 [DEBUG   ] Got command BAM from MCS: ref #95047
2019-03-21 20:23:20 [INFO    ] Finished processing BAM request
2019-03-21 20:23:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95047   8 58563 73400035 A  ERROR'
2019-03-21 20:23:20 [DEBUG   ] Got command BAM from MCS: ref #95046
2019-03-21 20:23:20 [INFO    ] Finished processing BAM request
2019-03-21 20:23:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95046   8 58563 73400039 A  ERROR'
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:23:20 [DEBUG   ] spawn_process: at 2019-03-21 20:23:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:23:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:23:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:23:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:23:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:23:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:23:23 [DEBUG   ] Finished updating board flags in 1.226 seconds
2019-03-21 20:23:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:23:52 [DEBUG   ] Got command BAM from MCS: ref #95054
2019-03-21 20:23:52 [INFO    ] Finished processing BAM request
2019-03-21 20:23:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:23:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95054   8 58563 73432035 A  ERROR'
2019-03-21 20:23:52 [DEBUG   ] Got command BAM from MCS: ref #95055
2019-03-21 20:23:52 [INFO    ] Finished processing BAM request
2019-03-21 20:23:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:23:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95055   8 58563 73432039 A  ERROR'
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:23:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:23:52 [DEBUG   ] spawn_process: at 2019-03-21 20:23:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:23:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:24:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:24:24 [DEBUG   ] Got command BAM from MCS: ref #95056
2019-03-21 20:24:24 [INFO    ] Finished processing BAM request
2019-03-21 20:24:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95056   8 58563 73464035 A  ERROR'
2019-03-21 20:24:24 [DEBUG   ] Got command BAM from MCS: ref #95057
2019-03-21 20:24:24 [INFO    ] Finished processing BAM request
2019-03-21 20:24:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95057   8 58563 73464039 A  ERROR'
2019-03-21 20:24:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:24:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:24:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:24:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:24:24 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:24:24 [DEBUG   ] spawn_process: at 2019-03-21 20:24:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:24:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:24:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 20:24:56 [DEBUG   ] Got command BAM from MCS: ref #95059
2019-03-21 20:24:56 [INFO    ] Finished processing BAM request
2019-03-21 20:24:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95059   8 58563 73496031 A  ERROR'
2019-03-21 20:24:56 [DEBUG   ] Got command BAM from MCS: ref #95058
2019-03-21 20:24:56 [INFO    ] Finished processing BAM request
2019-03-21 20:24:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95058   8 58563 73496035 A  ERROR'
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:24:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:24:56 [DEBUG   ] spawn_process: at 2019-03-21 20:24:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:25:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:25:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:25:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:25:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:25:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:25:24 [DEBUG   ] Finished updating board flags in 1.725 seconds
2019-03-21 20:25:28 [DEBUG   ] Got command BAM from MCS: ref #95060
2019-03-21 20:25:28 [INFO    ] Finished processing BAM request
2019-03-21 20:25:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95060   8 58563 73528027 A  ERROR'
2019-03-21 20:25:28 [DEBUG   ] Got command BAM from MCS: ref #95061
2019-03-21 20:25:28 [INFO    ] Finished processing BAM request
2019-03-21 20:25:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95061   8 58563 73528031 A  ERROR'
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:25:28 [DEBUG   ] spawn_process: at 2019-03-21 20:25:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:25:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:25:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:26:00 [DEBUG   ] Got command BAM from MCS: ref #95063
2019-03-21 20:26:00 [INFO    ] Finished processing BAM request
2019-03-21 20:26:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95063   8 58563 73560027 A  ERROR'
2019-03-21 20:26:00 [DEBUG   ] Got command BAM from MCS: ref #95062
2019-03-21 20:26:00 [INFO    ] Finished processing BAM request
2019-03-21 20:26:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95062   8 58563 73560031 A  ERROR'
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:26:00 [DEBUG   ] spawn_process: at 2019-03-21 20:26:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:26:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:26:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:26:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:26:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:26:23 [WARNING ] (13, 1, 'bot')
2019-03-21 20:26:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:26:23 [DEBUG   ] Finished updating board flags in 1.048 seconds
2019-03-21 20:26:32 [DEBUG   ] Got command BAM from MCS: ref #95065
2019-03-21 20:26:32 [INFO    ] Finished processing BAM request
2019-03-21 20:26:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95065   8 58563 73592035 A  ERROR'
2019-03-21 20:26:32 [DEBUG   ] Got command BAM from MCS: ref #95064
2019-03-21 20:26:32 [INFO    ] Finished processing BAM request
2019-03-21 20:26:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95064   8 58563 73592039 A  ERROR'
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:26:32 [DEBUG   ] spawn_process: at 2019-03-21 20:26:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:26:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:26:45 [DEBUG   ] Got command RPT from MCS: ref #95068
2019-03-21 20:26:45 [DEBUG   ] summary = ERROR
2019-03-21 20:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95068  13 58563 73605711 A  ERRORERROR'
2019-03-21 20:26:45 [DEBUG   ] Got command RPT from MCS: ref #95069
2019-03-21 20:26:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95069  77 58563 73605915 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:26:46 [DEBUG   ] Got command RPT from MCS: ref #95070
2019-03-21 20:26:46 [DEBUG   ] summary = ERROR
2019-03-21 20:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95070  13 58563 73606107 A  ERRORERROR'
2019-03-21 20:26:46 [DEBUG   ] Got command RPT from MCS: ref #95072
2019-03-21 20:26:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95072  77 58563 73606311 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:26:46 [DEBUG   ] Got command RPT from MCS: ref #95073
2019-03-21 20:26:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95073  12 58563 73606515 A  ERRORB›™š'
2019-03-21 20:26:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:27:04 [DEBUG   ] Got command BAM from MCS: ref #95085
2019-03-21 20:27:04 [INFO    ] Finished processing BAM request
2019-03-21 20:27:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:27:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95085   8 58563 73624031 A  ERROR'
2019-03-21 20:27:04 [DEBUG   ] Got command BAM from MCS: ref #95084
2019-03-21 20:27:04 [INFO    ] Finished processing BAM request
2019-03-21 20:27:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:27:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95084   8 58563 73624035 A  ERROR'
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:27:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:27:04 [DEBUG   ] spawn_process: at 2019-03-21 20:27:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:27:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:27:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:27:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:27:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:27:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:27:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:27:24 [DEBUG   ] Finished updating board flags in 1.558 seconds
2019-03-21 20:27:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:27:36 [DEBUG   ] Got command BAM from MCS: ref #95087
2019-03-21 20:27:36 [INFO    ] Finished processing BAM request
2019-03-21 20:27:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95087   8 58563 73656035 A  ERROR'
2019-03-21 20:27:36 [DEBUG   ] Got command BAM from MCS: ref #95086
2019-03-21 20:27:36 [INFO    ] Finished processing BAM request
2019-03-21 20:27:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95086   8 58563 73656039 A  ERROR'
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:27:36 [DEBUG   ] spawn_process: at 2019-03-21 20:27:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:27:40 [DEBUG   ] Got command RPT from MCS: ref #95088
2019-03-21 20:27:40 [DEBUG   ] summary = ERROR
2019-03-21 20:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95088  13 58563 73660855 A  ERRORERROR'
2019-03-21 20:27:40 [DEBUG   ] Got command RPT from MCS: ref #95089
2019-03-21 20:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95089  77 58563 73660855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:27:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:28:09 [DEBUG   ] Got command BAM from MCS: ref #95106
2019-03-21 20:28:09 [INFO    ] Finished processing BAM request
2019-03-21 20:28:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95106   8 58563 73689027 A  ERROR'
2019-03-21 20:28:09 [DEBUG   ] Got command BAM from MCS: ref #95105
2019-03-21 20:28:09 [INFO    ] Finished processing BAM request
2019-03-21 20:28:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95105   8 58563 73689031 A  ERROR'
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:28:09 [DEBUG   ] spawn_process: at 2019-03-21 20:28:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:28:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:28:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:28:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:28:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:28:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:28:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:28:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:28:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:28:24 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-03-21 20:28:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:28:42 [DEBUG   ] Got command BAM from MCS: ref #95107
2019-03-21 20:28:42 [INFO    ] Finished processing BAM request
2019-03-21 20:28:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95107   8 58563 73722035 A  ERROR'
2019-03-21 20:28:42 [DEBUG   ] Got command BAM from MCS: ref #95108
2019-03-21 20:28:42 [INFO    ] Finished processing BAM request
2019-03-21 20:28:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95108   8 58563 73722039 A  ERROR'
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:28:42 [DEBUG   ] spawn_process: at 2019-03-21 20:28:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:28:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-03-21 20:29:15 [DEBUG   ] Got command BAM from MCS: ref #95110
2019-03-21 20:29:15 [INFO    ] Finished processing BAM request
2019-03-21 20:29:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95110   8 58563 73755035 A  ERROR'
2019-03-21 20:29:15 [DEBUG   ] Got command BAM from MCS: ref #95109
2019-03-21 20:29:15 [INFO    ] Finished processing BAM request
2019-03-21 20:29:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95109   8 58563 73755039 A  ERROR'
2019-03-21 20:29:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:29:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:29:15 [DEBUG   ] spawn_process: at 2019-03-21 20:29:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:29:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:29:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:29:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:29:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:29:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:29:24 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-03-21 20:29:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:29:48 [DEBUG   ] Got command BAM from MCS: ref #95112
2019-03-21 20:29:48 [INFO    ] Finished processing BAM request
2019-03-21 20:29:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:29:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95112   8 58563 73788035 A  ERROR'
2019-03-21 20:29:48 [DEBUG   ] Got command BAM from MCS: ref #95111
2019-03-21 20:29:48 [INFO    ] Finished processing BAM request
2019-03-21 20:29:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:29:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95111   8 58563 73788039 A  ERROR'
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:29:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:29:48 [DEBUG   ] spawn_process: at 2019-03-21 20:29:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:29:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:30:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:30:21 [DEBUG   ] Got command BAM from MCS: ref #95119
2019-03-21 20:30:21 [INFO    ] Finished processing BAM request
2019-03-21 20:30:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:30:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95119   8 58563 73821031 A  ERROR'
2019-03-21 20:30:21 [DEBUG   ] Got command BAM from MCS: ref #95120
2019-03-21 20:30:21 [INFO    ] Finished processing BAM request
2019-03-21 20:30:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:30:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95120   8 58563 73821035 A  ERROR'
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:30:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:30:21 [DEBUG   ] spawn_process: at 2019-03-21 20:30:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:30:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:30:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:30:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:30:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:30:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:30:24 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-03-21 20:30:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 20:30:54 [DEBUG   ] Got command BAM from MCS: ref #95122
2019-03-21 20:30:54 [INFO    ] Finished processing BAM request
2019-03-21 20:30:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95122   8 58563 73854027 A  ERROR'
2019-03-21 20:30:54 [DEBUG   ] Got command BAM from MCS: ref #95121
2019-03-21 20:30:54 [INFO    ] Finished processing BAM request
2019-03-21 20:30:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95121   8 58563 73854031 A  ERROR'
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:30:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:30:54 [DEBUG   ] spawn_process: at 2019-03-21 20:30:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:30:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:31:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 20:31:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:31:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:31:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:31:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:31:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:31:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:31:24 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-03-21 20:31:27 [DEBUG   ] Got command BAM from MCS: ref #95123
2019-03-21 20:31:27 [INFO    ] Finished processing BAM request
2019-03-21 20:31:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:31:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95123   8 58563 73887035 A  ERROR'
2019-03-21 20:31:27 [DEBUG   ] Got command BAM from MCS: ref #95124
2019-03-21 20:31:27 [INFO    ] Finished processing BAM request
2019-03-21 20:31:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:31:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95124   8 58563 73887039 A  ERROR'
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:31:27 [DEBUG   ] spawn_process: at 2019-03-21 20:31:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:31:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:31:45 [DEBUG   ] Got command RPT from MCS: ref #95125
2019-03-21 20:31:45 [DEBUG   ] summary = ERROR
2019-03-21 20:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95125  13 58563 73905799 A  ERRORERROR'
2019-03-21 20:31:46 [DEBUG   ] Got command RPT from MCS: ref #95126
2019-03-21 20:31:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95126  77 58563 73906003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:31:46 [DEBUG   ] Got command RPT from MCS: ref #95127
2019-03-21 20:31:46 [DEBUG   ] summary = ERROR
2019-03-21 20:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95127  13 58563 73906195 A  ERRORERROR'
2019-03-21 20:31:46 [DEBUG   ] Got command RPT from MCS: ref #95128
2019-03-21 20:31:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95128  77 58563 73906399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:31:46 [DEBUG   ] Got command RPT from MCS: ref #95129
2019-03-21 20:31:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95129  12 58563 73906603 A  ERRORB›™š'
2019-03-21 20:31:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:32:00 [DEBUG   ] Got command BAM from MCS: ref #95130
2019-03-21 20:32:00 [INFO    ] Finished processing BAM request
2019-03-21 20:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95130   8 58563 73920035 A  ERROR'
2019-03-21 20:32:00 [DEBUG   ] Got command BAM from MCS: ref #95131
2019-03-21 20:32:00 [INFO    ] Finished processing BAM request
2019-03-21 20:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95131   8 58563 73920039 A  ERROR'
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:32:00 [DEBUG   ] spawn_process: at 2019-03-21 20:32:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:32:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:32:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 20:32:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:32:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:32:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:32:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:32:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:32:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:32:24 [DEBUG   ] Finished updating board flags in 0.985 seconds
2019-03-21 20:32:33 [DEBUG   ] Got command BAM from MCS: ref #95132
2019-03-21 20:32:33 [INFO    ] Finished processing BAM request
2019-03-21 20:32:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95132   8 58563 73953039 A  ERROR'
2019-03-21 20:32:33 [DEBUG   ] Got command BAM from MCS: ref #95133
2019-03-21 20:32:33 [INFO    ] Finished processing BAM request
2019-03-21 20:32:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95133   8 58563 73953047 A  ERROR'
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:32:33 [DEBUG   ] spawn_process: at 2019-03-21 20:32:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:32:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-21 20:32:40 [DEBUG   ] Got command RPT from MCS: ref #95134
2019-03-21 20:32:40 [DEBUG   ] summary = ERROR
2019-03-21 20:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95134  13 58563 73960851 A  ERRORERROR'
2019-03-21 20:32:40 [DEBUG   ] Got command RPT from MCS: ref #95135
2019-03-21 20:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95135  77 58563 73960851 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:32:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:33:06 [DEBUG   ] Got command BAM from MCS: ref #95158
2019-03-21 20:33:06 [INFO    ] Finished processing BAM request
2019-03-21 20:33:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95158   8 58563 73986031 A  ERROR'
2019-03-21 20:33:06 [DEBUG   ] Got command BAM from MCS: ref #95157
2019-03-21 20:33:06 [INFO    ] Finished processing BAM request
2019-03-21 20:33:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95157   8 58563 73986035 A  ERROR'
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:33:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:33:06 [DEBUG   ] spawn_process: at 2019-03-21 20:33:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:33:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:33:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:33:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:33:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:33:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:33:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:33:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:33:25 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-03-21 20:33:35 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2019-03-21 20:33:39 [DEBUG   ] Got command BAM from MCS: ref #95160
2019-03-21 20:33:39 [INFO    ] Finished processing BAM request
2019-03-21 20:33:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95160   8 58563 74019027 A  ERROR'
2019-03-21 20:33:39 [DEBUG   ] Got command BAM from MCS: ref #95159
2019-03-21 20:33:39 [INFO    ] Finished processing BAM request
2019-03-21 20:33:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95159   8 58563 74019031 A  ERROR'
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:33:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:33:39 [DEBUG   ] spawn_process: at 2019-03-21 20:33:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:33:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:34:12 [DEBUG   ] Got command BAM from MCS: ref #95161
2019-03-21 20:34:12 [INFO    ] Finished processing BAM request
2019-03-21 20:34:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95161   8 58563 74052035 A  ERROR'
2019-03-21 20:34:12 [DEBUG   ] Got command BAM from MCS: ref #95162
2019-03-21 20:34:12 [INFO    ] Finished processing BAM request
2019-03-21 20:34:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95162   8 58563 74052039 A  ERROR'
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:34:12 [DEBUG   ] spawn_process: at 2019-03-21 20:34:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:34:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-03-21 20:34:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:34:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:34:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:34:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:34:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:34:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:34:24 [DEBUG   ] Finished updating board flags in 1.239 seconds
2019-03-21 20:34:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:34:46 [DEBUG   ] Got command BAM from MCS: ref #95164
2019-03-21 20:34:46 [INFO    ] Finished processing BAM request
2019-03-21 20:34:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95164   8 58563 74086035 A  ERROR'
2019-03-21 20:34:46 [DEBUG   ] Got command BAM from MCS: ref #95163
2019-03-21 20:34:46 [INFO    ] Finished processing BAM request
2019-03-21 20:34:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95163   8 58563 74086039 A  ERROR'
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:34:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:34:46 [DEBUG   ] spawn_process: at 2019-03-21 20:34:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:34:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:35:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:35:20 [DEBUG   ] Got command BAM from MCS: ref #95165
2019-03-21 20:35:20 [INFO    ] Finished processing BAM request
2019-03-21 20:35:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95165   8 58563 74120035 A  ERROR'
2019-03-21 20:35:20 [DEBUG   ] Got command BAM from MCS: ref #95166
2019-03-21 20:35:20 [INFO    ] Finished processing BAM request
2019-03-21 20:35:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95166   8 58563 74120043 A  ERROR'
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:35:20 [DEBUG   ] spawn_process: at 2019-03-21 20:35:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:35:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:35:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:35:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:35:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:35:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:35:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:35:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:35:24 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-03-21 20:35:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:35:54 [DEBUG   ] Got command BAM from MCS: ref #95174
2019-03-21 20:35:54 [INFO    ] Finished processing BAM request
2019-03-21 20:35:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95174   8 58563 74154031 A  ERROR'
2019-03-21 20:35:54 [DEBUG   ] Got command BAM from MCS: ref #95173
2019-03-21 20:35:54 [INFO    ] Finished processing BAM request
2019-03-21 20:35:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95173   8 58563 74154035 A  ERROR'
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:35:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:35:54 [DEBUG   ] spawn_process: at 2019-03-21 20:35:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:35:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:36:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:36:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:36:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:36:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:36:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:36:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:36:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:36:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:36:24 [DEBUG   ] Finished updating board flags in 1.263 seconds
2019-03-21 20:36:28 [DEBUG   ] Got command BAM from MCS: ref #95175
2019-03-21 20:36:28 [INFO    ] Finished processing BAM request
2019-03-21 20:36:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95175   8 58563 74188035 A  ERROR'
2019-03-21 20:36:28 [DEBUG   ] Got command BAM from MCS: ref #95176
2019-03-21 20:36:28 [INFO    ] Finished processing BAM request
2019-03-21 20:36:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95176   8 58563 74188043 A  ERROR'
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:36:28 [DEBUG   ] spawn_process: at 2019-03-21 20:36:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:36:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:36:45 [DEBUG   ] Got command RPT from MCS: ref #95179
2019-03-21 20:36:45 [DEBUG   ] summary = ERROR
2019-03-21 20:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95179  13 58563 74205883 A  ERRORERROR'
2019-03-21 20:36:46 [DEBUG   ] Got command RPT from MCS: ref #95180
2019-03-21 20:36:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95180  77 58563 74206087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:36:46 [DEBUG   ] Got command RPT from MCS: ref #95181
2019-03-21 20:36:46 [DEBUG   ] summary = ERROR
2019-03-21 20:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95181  13 58563 74206291 A  ERRORERROR'
2019-03-21 20:36:46 [DEBUG   ] Got command RPT from MCS: ref #95183
2019-03-21 20:36:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95183  77 58563 74206483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:36:46 [DEBUG   ] Got command RPT from MCS: ref #95184
2019-03-21 20:36:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95184  12 58563 74206687 A  ERRORB›™š'
2019-03-21 20:36:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:37:02 [DEBUG   ] Got command BAM from MCS: ref #95189
2019-03-21 20:37:02 [INFO    ] Finished processing BAM request
2019-03-21 20:37:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95189   8 58563 74222027 A  ERROR'
2019-03-21 20:37:02 [DEBUG   ] Got command BAM from MCS: ref #95190
2019-03-21 20:37:02 [INFO    ] Finished processing BAM request
2019-03-21 20:37:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95190   8 58563 74222031 A  ERROR'
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:37:02 [DEBUG   ] spawn_process: at 2019-03-21 20:37:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:37:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:37:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:37:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:37:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:37:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:37:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:37:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:37:24 [DEBUG   ] Finished updating board flags in 1.141 seconds
2019-03-21 20:37:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:37:36 [DEBUG   ] Got command BAM from MCS: ref #95191
2019-03-21 20:37:36 [INFO    ] Finished processing BAM request
2019-03-21 20:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95191   8 58563 74256035 A  ERROR'
2019-03-21 20:37:36 [DEBUG   ] Got command BAM from MCS: ref #95192
2019-03-21 20:37:36 [INFO    ] Finished processing BAM request
2019-03-21 20:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95192   8 58563 74256039 A  ERROR'
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:37:36 [DEBUG   ] spawn_process: at 2019-03-21 20:37:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:37:40 [DEBUG   ] Got command RPT from MCS: ref #95193
2019-03-21 20:37:40 [DEBUG   ] summary = ERROR
2019-03-21 20:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95193  13 58563 74260851 A  ERRORERROR'
2019-03-21 20:37:40 [DEBUG   ] Got command RPT from MCS: ref #95194
2019-03-21 20:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95194  77 58563 74260851 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:37:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:38:10 [DEBUG   ] Got command BAM from MCS: ref #95211
2019-03-21 20:38:10 [INFO    ] Finished processing BAM request
2019-03-21 20:38:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95211   8 58563 74290027 A  ERROR'
2019-03-21 20:38:10 [DEBUG   ] Got command BAM from MCS: ref #95210
2019-03-21 20:38:10 [INFO    ] Finished processing BAM request
2019-03-21 20:38:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95210   8 58563 74290031 A  ERROR'
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:38:10 [DEBUG   ] spawn_process: at 2019-03-21 20:38:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:38:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:38:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:38:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:38:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:38:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:38:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:38:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:38:24 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-03-21 20:38:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:38:44 [DEBUG   ] Got command BAM from MCS: ref #95213
2019-03-21 20:38:44 [INFO    ] Finished processing BAM request
2019-03-21 20:38:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95213   8 58563 74324027 A  ERROR'
2019-03-21 20:38:44 [DEBUG   ] Got command BAM from MCS: ref #95212
2019-03-21 20:38:44 [INFO    ] Finished processing BAM request
2019-03-21 20:38:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:38:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95212   8 58563 74324031 A  ERROR'
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:38:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:38:44 [DEBUG   ] spawn_process: at 2019-03-21 20:38:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:38:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:39:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:39:18 [DEBUG   ] Got command BAM from MCS: ref #95221
2019-03-21 20:39:18 [INFO    ] Finished processing BAM request
2019-03-21 20:39:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95221   8 58563 74358031 A  ERROR'
2019-03-21 20:39:18 [DEBUG   ] Got command BAM from MCS: ref #95220
2019-03-21 20:39:18 [INFO    ] Finished processing BAM request
2019-03-21 20:39:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95220   8 58563 74358035 A  ERROR'
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:39:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:39:18 [DEBUG   ] spawn_process: at 2019-03-21 20:39:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:39:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:39:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:39:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:39:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:39:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:39:24 [WARNING ] (13, 1, 'bot')
2019-03-21 20:39:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:39:24 [DEBUG   ] Finished updating board flags in 0.969 seconds
2019-03-21 20:39:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:39:52 [DEBUG   ] Got command BAM from MCS: ref #95222
2019-03-21 20:39:52 [INFO    ] Finished processing BAM request
2019-03-21 20:39:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95222   8 58563 74392027 A  ERROR'
2019-03-21 20:39:52 [DEBUG   ] Got command BAM from MCS: ref #95223
2019-03-21 20:39:52 [INFO    ] Finished processing BAM request
2019-03-21 20:39:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95223   8 58563 74392031 A  ERROR'
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:39:52 [DEBUG   ] spawn_process: at 2019-03-21 20:39:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:39:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-03-21 20:40:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:40:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:40:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:40:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:40:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:40:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:40:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:40:25 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-03-21 20:40:26 [DEBUG   ] Got command BAM from MCS: ref #95224
2019-03-21 20:40:26 [INFO    ] Finished processing BAM request
2019-03-21 20:40:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95224   8 58563 74426031 A  ERROR'
2019-03-21 20:40:26 [DEBUG   ] Got command BAM from MCS: ref #95225
2019-03-21 20:40:26 [INFO    ] Finished processing BAM request
2019-03-21 20:40:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95225   8 58563 74426035 A  ERROR'
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:40:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:40:26 [DEBUG   ] spawn_process: at 2019-03-21 20:40:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:40:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:40:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:41:01 [DEBUG   ] Got command BAM from MCS: ref #95226
2019-03-21 20:41:01 [INFO    ] Finished processing BAM request
2019-03-21 20:41:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95226   8 58563 74461027 A  ERROR'
2019-03-21 20:41:01 [DEBUG   ] Got command BAM from MCS: ref #95227
2019-03-21 20:41:01 [INFO    ] Finished processing BAM request
2019-03-21 20:41:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95227   8 58563 74461031 A  ERROR'
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:41:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:41:01 [DEBUG   ] spawn_process: at 2019-03-21 20:41:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:41:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:41:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 20:41:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:41:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:41:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:41:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:41:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:41:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:41:25 [DEBUG   ] Finished updating board flags in 1.216 seconds
2019-03-21 20:41:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:41:36 [DEBUG   ] Got command BAM from MCS: ref #95229
2019-03-21 20:41:36 [INFO    ] Finished processing BAM request
2019-03-21 20:41:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95229   8 58563 74496035 A  ERROR'
2019-03-21 20:41:36 [DEBUG   ] Got command BAM from MCS: ref #95228
2019-03-21 20:41:36 [INFO    ] Finished processing BAM request
2019-03-21 20:41:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95228   8 58563 74496039 A  ERROR'
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:41:36 [DEBUG   ] spawn_process: at 2019-03-21 20:41:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:41:45 [DEBUG   ] Got command RPT from MCS: ref #95230
2019-03-21 20:41:45 [DEBUG   ] summary = ERROR
2019-03-21 20:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95230  13 58563 74505967 A  ERRORERROR'
2019-03-21 20:41:46 [DEBUG   ] Got command RPT from MCS: ref #95231
2019-03-21 20:41:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95231  77 58563 74506171 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:41:46 [DEBUG   ] Got command RPT from MCS: ref #95232
2019-03-21 20:41:46 [DEBUG   ] summary = ERROR
2019-03-21 20:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95232  13 58563 74506375 A  ERRORERROR'
2019-03-21 20:41:46 [DEBUG   ] Got command RPT from MCS: ref #95233
2019-03-21 20:41:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95233  77 58563 74506567 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:41:46 [DEBUG   ] Got command RPT from MCS: ref #95234
2019-03-21 20:41:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95234  12 58563 74506771 A  ERRORB›™š'
2019-03-21 20:41:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:42:11 [DEBUG   ] Got command BAM from MCS: ref #95241
2019-03-21 20:42:11 [INFO    ] Finished processing BAM request
2019-03-21 20:42:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95241   8 58563 74531031 A  ERROR'
2019-03-21 20:42:11 [DEBUG   ] Got command BAM from MCS: ref #95242
2019-03-21 20:42:11 [INFO    ] Finished processing BAM request
2019-03-21 20:42:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95242   8 58563 74531039 A  ERROR'
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:42:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:42:11 [DEBUG   ] spawn_process: at 2019-03-21 20:42:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:42:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-03-21 20:42:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:42:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:42:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:42:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:42:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:42:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:42:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:42:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:42:25 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-03-21 20:42:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:42:40 [DEBUG   ] Got command RPT from MCS: ref #95243
2019-03-21 20:42:40 [DEBUG   ] summary = ERROR
2019-03-21 20:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95243  13 58563 74560859 A  ERRORERROR'
2019-03-21 20:42:40 [DEBUG   ] Got command RPT from MCS: ref #95244
2019-03-21 20:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95244  77 58563 74560859 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:42:46 [DEBUG   ] Got command BAM from MCS: ref #95260
2019-03-21 20:42:46 [INFO    ] Finished processing BAM request
2019-03-21 20:42:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:42:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95260   8 58563 74566035 A  ERROR'
2019-03-21 20:42:46 [DEBUG   ] Got command BAM from MCS: ref #95261
2019-03-21 20:42:46 [INFO    ] Finished processing BAM request
2019-03-21 20:42:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:42:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95261   8 58563 74566039 A  ERROR'
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:42:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:42:46 [DEBUG   ] spawn_process: at 2019-03-21 20:42:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:42:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:43:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:43:21 [DEBUG   ] Got command BAM from MCS: ref #95263
2019-03-21 20:43:21 [INFO    ] Finished processing BAM request
2019-03-21 20:43:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95263   8 58563 74601031 A  ERROR'
2019-03-21 20:43:21 [DEBUG   ] Got command BAM from MCS: ref #95262
2019-03-21 20:43:21 [INFO    ] Finished processing BAM request
2019-03-21 20:43:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95262   8 58563 74601035 A  ERROR'
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:43:21 [DEBUG   ] spawn_process: at 2019-03-21 20:43:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:43:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:43:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:43:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:43:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:43:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:43:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:43:25 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-03-21 20:43:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 20:43:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 20:43:56 [DEBUG   ] Got command BAM from MCS: ref #95265
2019-03-21 20:43:56 [INFO    ] Finished processing BAM request
2019-03-21 20:43:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95265   8 58563 74636035 A  ERROR'
2019-03-21 20:43:56 [DEBUG   ] Got command BAM from MCS: ref #95264
2019-03-21 20:43:56 [INFO    ] Finished processing BAM request
2019-03-21 20:43:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:43:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95264   8 58563 74636039 A  ERROR'
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:43:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:43:56 [DEBUG   ] spawn_process: at 2019-03-21 20:43:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:44:15 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 20:44:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:44:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:44:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:44:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:44:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:44:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:44:26 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-03-21 20:44:31 [DEBUG   ] Got command BAM from MCS: ref #95267
2019-03-21 20:44:31 [INFO    ] Finished processing BAM request
2019-03-21 20:44:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:44:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95267   8 58563 74671027 A  ERROR'
2019-03-21 20:44:31 [DEBUG   ] Got command BAM from MCS: ref #95266
2019-03-21 20:44:31 [INFO    ] Finished processing BAM request
2019-03-21 20:44:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:44:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95266   8 58563 74671031 A  ERROR'
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:44:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:44:31 [DEBUG   ] spawn_process: at 2019-03-21 20:44:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:44:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 20:44:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 20:45:06 [DEBUG   ] Got command BAM from MCS: ref #95275
2019-03-21 20:45:06 [INFO    ] Finished processing BAM request
2019-03-21 20:45:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95275   8 58563 74706027 A  ERROR'
2019-03-21 20:45:06 [DEBUG   ] Got command BAM from MCS: ref #95274
2019-03-21 20:45:06 [INFO    ] Finished processing BAM request
2019-03-21 20:45:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95274   8 58563 74706031 A  ERROR'
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:45:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:45:06 [DEBUG   ] spawn_process: at 2019-03-21 20:45:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:45:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 20:45:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:45:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:45:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:45:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:45:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:45:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:45:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:45:25 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-03-21 20:45:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:45:41 [DEBUG   ] Got command BAM from MCS: ref #95277
2019-03-21 20:45:41 [INFO    ] Finished processing BAM request
2019-03-21 20:45:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:45:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95277   8 58563 74741027 A  ERROR'
2019-03-21 20:45:41 [DEBUG   ] Got command BAM from MCS: ref #95276
2019-03-21 20:45:41 [INFO    ] Finished processing BAM request
2019-03-21 20:45:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:45:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95276   8 58563 74741031 A  ERROR'
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:45:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:45:41 [DEBUG   ] spawn_process: at 2019-03-21 20:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:45:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:46:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:46:17 [DEBUG   ] Got command BAM from MCS: ref #95279
2019-03-21 20:46:17 [INFO    ] Finished processing BAM request
2019-03-21 20:46:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:46:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95279   8 58563 74777035 A  ERROR'
2019-03-21 20:46:17 [DEBUG   ] Got command BAM from MCS: ref #95278
2019-03-21 20:46:17 [INFO    ] Finished processing BAM request
2019-03-21 20:46:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:46:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95278   8 58563 74777039 A  ERROR'
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:46:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:46:17 [DEBUG   ] spawn_process: at 2019-03-21 20:46:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:46:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:46:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:46:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:46:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:46:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:46:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:46:25 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-03-21 20:46:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:46:46 [DEBUG   ] Got command RPT from MCS: ref #95282
2019-03-21 20:46:46 [DEBUG   ] summary = ERROR
2019-03-21 20:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95282  13 58563 74806059 A  ERRORERROR'
2019-03-21 20:46:46 [DEBUG   ] Got command RPT from MCS: ref #95283
2019-03-21 20:46:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95283  77 58563 74806251 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:46:46 [DEBUG   ] Got command RPT from MCS: ref #95284
2019-03-21 20:46:46 [DEBUG   ] summary = ERROR
2019-03-21 20:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95284  13 58563 74806455 A  ERRORERROR'
2019-03-21 20:46:46 [DEBUG   ] Got command RPT from MCS: ref #95286
2019-03-21 20:46:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95286  77 58563 74806659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:46:46 [DEBUG   ] Got command RPT from MCS: ref #95288
2019-03-21 20:46:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95288  12 58563 74806863 A  ERRORBœ™š'
2019-03-21 20:46:53 [DEBUG   ] Got command BAM from MCS: ref #95293
2019-03-21 20:46:53 [INFO    ] Finished processing BAM request
2019-03-21 20:46:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95293   8 58563 74813035 A  ERROR'
2019-03-21 20:46:53 [DEBUG   ] Got command BAM from MCS: ref #95292
2019-03-21 20:46:53 [INFO    ] Finished processing BAM request
2019-03-21 20:46:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95292   8 58563 74813039 A  ERROR'
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:46:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:46:53 [DEBUG   ] spawn_process: at 2019-03-21 20:46:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:46:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:47:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:47:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:47:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:47:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:47:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:47:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:47:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:47:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:47:25 [DEBUG   ] Finished updating board flags in 1.482 seconds
2019-03-21 20:47:29 [DEBUG   ] Got command BAM from MCS: ref #95294
2019-03-21 20:47:29 [INFO    ] Finished processing BAM request
2019-03-21 20:47:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95294   8 58563 74849035 A  ERROR'
2019-03-21 20:47:29 [DEBUG   ] Got command BAM from MCS: ref #95295
2019-03-21 20:47:29 [INFO    ] Finished processing BAM request
2019-03-21 20:47:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95295   8 58563 74849039 A  ERROR'
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:47:29 [DEBUG   ] spawn_process: at 2019-03-21 20:47:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:47:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:47:40 [DEBUG   ] Got command RPT from MCS: ref #95296
2019-03-21 20:47:40 [DEBUG   ] summary = ERROR
2019-03-21 20:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95296  13 58563 74860855 A  ERRORERROR'
2019-03-21 20:47:40 [DEBUG   ] Got command RPT from MCS: ref #95297
2019-03-21 20:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95297  77 58563 74860855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:47:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 20:48:05 [DEBUG   ] Got command BAM from MCS: ref #95319
2019-03-21 20:48:05 [INFO    ] Finished processing BAM request
2019-03-21 20:48:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95319   8 58563 74885027 A  ERROR'
2019-03-21 20:48:05 [DEBUG   ] Got command BAM from MCS: ref #95320
2019-03-21 20:48:05 [INFO    ] Finished processing BAM request
2019-03-21 20:48:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95320   8 58563 74885031 A  ERROR'
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:48:05 [DEBUG   ] spawn_process: at 2019-03-21 20:48:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:48:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 20:48:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:48:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:48:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:48:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:48:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:48:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:48:25 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-03-21 20:48:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 20:48:41 [DEBUG   ] Got command BAM from MCS: ref #95322
2019-03-21 20:48:41 [INFO    ] Finished processing BAM request
2019-03-21 20:48:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95322   8 58563 74921035 A  ERROR'
2019-03-21 20:48:41 [DEBUG   ] Got command BAM from MCS: ref #95321
2019-03-21 20:48:41 [INFO    ] Finished processing BAM request
2019-03-21 20:48:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95321   8 58563 74921039 A  ERROR'
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:48:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:48:41 [DEBUG   ] spawn_process: at 2019-03-21 20:48:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:48:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 20:49:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 20:49:17 [DEBUG   ] Got command BAM from MCS: ref #95324
2019-03-21 20:49:17 [INFO    ] Finished processing BAM request
2019-03-21 20:49:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95324   8 58563 74957031 A  ERROR'
2019-03-21 20:49:17 [DEBUG   ] Got command BAM from MCS: ref #95323
2019-03-21 20:49:17 [INFO    ] Finished processing BAM request
2019-03-21 20:49:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95323   8 58563 74957035 A  ERROR'
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:49:17 [DEBUG   ] spawn_process: at 2019-03-21 20:49:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:49:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:49:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:49:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:49:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:49:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:49:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:49:25 [DEBUG   ] Finished updating board flags in 1.133 seconds
2019-03-21 20:49:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:49:53 [DEBUG   ] Got command BAM from MCS: ref #95326
2019-03-21 20:49:53 [INFO    ] Finished processing BAM request
2019-03-21 20:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95326   8 58563 74993039 A  ERROR'
2019-03-21 20:49:53 [DEBUG   ] Got command BAM from MCS: ref #95325
2019-03-21 20:49:53 [INFO    ] Finished processing BAM request
2019-03-21 20:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95325   8 58563 74993043 A  ERROR'
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:49:53 [DEBUG   ] spawn_process: at 2019-03-21 20:49:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:49:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:50:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 20:50:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:50:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:50:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:50:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:50:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:50:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:50:25 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-03-21 20:50:29 [DEBUG   ] Got command BAM from MCS: ref #95327
2019-03-21 20:50:29 [INFO    ] Finished processing BAM request
2019-03-21 20:50:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:50:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95327   8 58563 75029031 A  ERROR'
2019-03-21 20:50:29 [DEBUG   ] Got command BAM from MCS: ref #95328
2019-03-21 20:50:29 [INFO    ] Finished processing BAM request
2019-03-21 20:50:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:50:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95328   8 58563 75029035 A  ERROR'
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:50:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:50:29 [DEBUG   ] spawn_process: at 2019-03-21 20:50:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:50:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 20:50:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 20:51:05 [DEBUG   ] Got command BAM from MCS: ref #95336
2019-03-21 20:51:05 [INFO    ] Finished processing BAM request
2019-03-21 20:51:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95336   8 58563 75065031 A  ERROR'
2019-03-21 20:51:05 [DEBUG   ] Got command BAM from MCS: ref #95335
2019-03-21 20:51:05 [INFO    ] Finished processing BAM request
2019-03-21 20:51:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95335   8 58563 75065035 A  ERROR'
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:51:05 [DEBUG   ] spawn_process: at 2019-03-21 20:51:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:51:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:51:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:51:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:51:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:51:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:51:25 [WARNING ] (13, 1, 'bot')
2019-03-21 20:51:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:51:25 [DEBUG   ] Finished updating board flags in 0.980 seconds
2019-03-21 20:51:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:51:42 [DEBUG   ] Got command BAM from MCS: ref #95338
2019-03-21 20:51:42 [INFO    ] Finished processing BAM request
2019-03-21 20:51:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95338   8 58563 75102035 A  ERROR'
2019-03-21 20:51:42 [DEBUG   ] Got command BAM from MCS: ref #95337
2019-03-21 20:51:42 [INFO    ] Finished processing BAM request
2019-03-21 20:51:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95337   8 58563 75102043 A  ERROR'
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:51:42 [DEBUG   ] spawn_process: at 2019-03-21 20:51:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:51:46 [DEBUG   ] Got command RPT from MCS: ref #95339
2019-03-21 20:51:46 [DEBUG   ] summary = ERROR
2019-03-21 20:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95339  13 58563 75106143 A  ERRORERROR'
2019-03-21 20:51:46 [DEBUG   ] Got command RPT from MCS: ref #95340
2019-03-21 20:51:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95340  77 58563 75106347 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:51:46 [DEBUG   ] Got command RPT from MCS: ref #95341
2019-03-21 20:51:46 [DEBUG   ] summary = ERROR
2019-03-21 20:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95341  13 58563 75106539 A  ERRORERROR'
2019-03-21 20:51:46 [DEBUG   ] Got command RPT from MCS: ref #95342
2019-03-21 20:51:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95342  77 58563 75106743 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:51:46 [DEBUG   ] Got command RPT from MCS: ref #95343
2019-03-21 20:51:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95343  12 58563 75106947 A  ERRORBœ™š'
2019-03-21 20:51:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:52:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:52:19 [DEBUG   ] Got command BAM from MCS: ref #95345
2019-03-21 20:52:19 [INFO    ] Finished processing BAM request
2019-03-21 20:52:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95345   8 58563 75139027 A  ERROR'
2019-03-21 20:52:19 [DEBUG   ] Got command BAM from MCS: ref #95344
2019-03-21 20:52:19 [INFO    ] Finished processing BAM request
2019-03-21 20:52:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95344   8 58563 75139031 A  ERROR'
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:52:19 [DEBUG   ] spawn_process: at 2019-03-21 20:52:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:52:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:52:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:52:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:52:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:52:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:52:26 [DEBUG   ] Finished updating board flags in 1.360 seconds
2019-03-21 20:52:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:52:40 [DEBUG   ] Got command RPT from MCS: ref #95346
2019-03-21 20:52:40 [DEBUG   ] summary = ERROR
2019-03-21 20:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95346  13 58563 75160855 A  ERRORERROR'
2019-03-21 20:52:40 [DEBUG   ] Got command RPT from MCS: ref #95347
2019-03-21 20:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95347  77 58563 75160855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:52:56 [DEBUG   ] Got command BAM from MCS: ref #95364
2019-03-21 20:52:56 [INFO    ] Finished processing BAM request
2019-03-21 20:52:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:52:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95364   8 58563 75176027 A  ERROR'
2019-03-21 20:52:56 [DEBUG   ] Got command BAM from MCS: ref #95363
2019-03-21 20:52:56 [INFO    ] Finished processing BAM request
2019-03-21 20:52:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:52:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95363   8 58563 75176031 A  ERROR'
2019-03-21 20:52:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:52:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:52:56 [DEBUG   ] spawn_process: at 2019-03-21 20:52:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:53:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:53:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:53:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:53:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:53:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:53:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:53:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:53:26 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-03-21 20:53:33 [DEBUG   ] Got command BAM from MCS: ref #95366
2019-03-21 20:53:33 [INFO    ] Finished processing BAM request
2019-03-21 20:53:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95366   8 58563 75213035 A  ERROR'
2019-03-21 20:53:33 [DEBUG   ] Got command BAM from MCS: ref #95365
2019-03-21 20:53:33 [INFO    ] Finished processing BAM request
2019-03-21 20:53:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95365   8 58563 75213043 A  ERROR'
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 20:53:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 20:53:33 [DEBUG   ] spawn_process: at 2019-03-21 20:53:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 20:53:36 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 20:53:56 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 20:54:10 [DEBUG   ] Got command BAM from MCS: ref #95373
2019-03-21 20:54:10 [INFO    ] Finished processing BAM request
2019-03-21 20:54:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95373   8 58563 75250035 A  ERROR'
2019-03-21 20:54:10 [DEBUG   ] Got command BAM from MCS: ref #95374
2019-03-21 20:54:10 [INFO    ] Finished processing BAM request
2019-03-21 20:54:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:54:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95374   8 58563 75250039 A  ERROR'
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:54:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:54:10 [DEBUG   ] spawn_process: at 2019-03-21 20:54:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:54:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 20:54:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:54:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 20:54:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:54:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:54:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:54:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:54:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:54:26 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-03-21 20:54:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 20:54:47 [DEBUG   ] Got command BAM from MCS: ref #95376
2019-03-21 20:54:47 [INFO    ] Finished processing BAM request
2019-03-21 20:54:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95376   8 58563 75287031 A  ERROR'
2019-03-21 20:54:47 [DEBUG   ] Got command BAM from MCS: ref #95375
2019-03-21 20:54:47 [INFO    ] Finished processing BAM request
2019-03-21 20:54:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95375   8 58563 75287035 A  ERROR'
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:54:47 [DEBUG   ] spawn_process: at 2019-03-21 20:54:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:54:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 20:55:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 20:55:24 [DEBUG   ] Got command BAM from MCS: ref #95377
2019-03-21 20:55:24 [INFO    ] Finished processing BAM request
2019-03-21 20:55:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95377   8 58563 75324027 A  ERROR'
2019-03-21 20:55:24 [DEBUG   ] Got command BAM from MCS: ref #95378
2019-03-21 20:55:24 [INFO    ] Finished processing BAM request
2019-03-21 20:55:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95378   8 58563 75324031 A  ERROR'
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:55:24 [DEBUG   ] spawn_process: at 2019-03-21 20:55:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:55:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:55:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:55:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:55:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:55:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:55:26 [DEBUG   ] Finished updating board flags in 1.176 seconds
2019-03-21 20:55:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 20:55:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:56:01 [DEBUG   ] Got command BAM from MCS: ref #95379
2019-03-21 20:56:01 [INFO    ] Finished processing BAM request
2019-03-21 20:56:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:56:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95379   8 58563 75361023 A  ERROR'
2019-03-21 20:56:01 [DEBUG   ] Got command BAM from MCS: ref #95380
2019-03-21 20:56:01 [INFO    ] Finished processing BAM request
2019-03-21 20:56:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:56:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95380   8 58563 75361027 A  ERROR'
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:56:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:56:01 [DEBUG   ] spawn_process: at 2019-03-21 20:56:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:56:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:56:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:56:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:56:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:56:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:56:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:56:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:56:26 [DEBUG   ] Finished updating board flags in 0.993 seconds
2019-03-21 20:56:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:56:38 [DEBUG   ] Got command BAM from MCS: ref #95381
2019-03-21 20:56:38 [INFO    ] Finished processing BAM request
2019-03-21 20:56:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95381   8 58563 75398027 A  ERROR'
2019-03-21 20:56:38 [DEBUG   ] Got command BAM from MCS: ref #95382
2019-03-21 20:56:38 [INFO    ] Finished processing BAM request
2019-03-21 20:56:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95382   8 58563 75398031 A  ERROR'
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 20:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 20:56:38 [DEBUG   ] spawn_process: at 2019-03-21 20:56:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 20:56:46 [DEBUG   ] Got command RPT from MCS: ref #95385
2019-03-21 20:56:46 [DEBUG   ] summary = ERROR
2019-03-21 20:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95385  13 58563 75406227 A  ERRORERROR'
2019-03-21 20:56:46 [DEBUG   ] Got command RPT from MCS: ref #95386
2019-03-21 20:56:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95386  77 58563 75406431 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:56:46 [DEBUG   ] Got command RPT from MCS: ref #95387
2019-03-21 20:56:46 [DEBUG   ] summary = ERROR
2019-03-21 20:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95387  13 58563 75406623 A  ERRORERROR'
2019-03-21 20:56:46 [DEBUG   ] Got command RPT from MCS: ref #95389
2019-03-21 20:56:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95389  77 58563 75406827 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:56:47 [DEBUG   ] Got command RPT from MCS: ref #95390
2019-03-21 20:56:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 20:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95390  12 58563 75407031 A  ERRORBœ™š'
2019-03-21 20:56:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:57:16 [DEBUG   ] Got command BAM from MCS: ref #95402
2019-03-21 20:57:16 [INFO    ] Finished processing BAM request
2019-03-21 20:57:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:57:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95402   8 58563 75436027 A  ERROR'
2019-03-21 20:57:16 [DEBUG   ] Got command BAM from MCS: ref #95401
2019-03-21 20:57:16 [INFO    ] Finished processing BAM request
2019-03-21 20:57:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:57:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95401   8 58563 75436031 A  ERROR'
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:57:16 [DEBUG   ] spawn_process: at 2019-03-21 20:57:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:57:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 20:57:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:57:27 [WARNING ] (13, 1, 'bot')
2019-03-21 20:57:27 [WARNING ] (13, 1, 'bot')
2019-03-21 20:57:27 [WARNING ] (13, 1, 'bot')
2019-03-21 20:57:27 [WARNING ] (13, 1, 'bot')
2019-03-21 20:57:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:57:27 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-03-21 20:57:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 20:57:40 [DEBUG   ] Got command RPT from MCS: ref #95403
2019-03-21 20:57:40 [DEBUG   ] summary = ERROR
2019-03-21 20:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95403  13 58563 75460863 A  ERRORERROR'
2019-03-21 20:57:40 [DEBUG   ] Got command RPT from MCS: ref #95404
2019-03-21 20:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 20:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95404  77 58563 75460863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 20:57:54 [DEBUG   ] Got command BAM from MCS: ref #95420
2019-03-21 20:57:54 [INFO    ] Finished processing BAM request
2019-03-21 20:57:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:57:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95420   8 58563 75474031 A  ERROR'
2019-03-21 20:57:54 [DEBUG   ] Got command BAM from MCS: ref #95421
2019-03-21 20:57:54 [INFO    ] Finished processing BAM request
2019-03-21 20:57:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:57:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95421   8 58563 75474035 A  ERROR'
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 20:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 20:57:54 [DEBUG   ] spawn_process: at 2019-03-21 20:57:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 20:57:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 20:58:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 20:58:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 20:58:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:58:27 [WARNING ] (13, 1, 'bot')
2019-03-21 20:58:27 [WARNING ] (13, 1, 'bot')
2019-03-21 20:58:27 [WARNING ] (13, 1, 'bot')
2019-03-21 20:58:27 [WARNING ] (13, 1, 'bot')
2019-03-21 20:58:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:58:27 [DEBUG   ] Finished updating board flags in 1.646 seconds
2019-03-21 20:58:32 [DEBUG   ] Got command BAM from MCS: ref #95423
2019-03-21 20:58:32 [INFO    ] Finished processing BAM request
2019-03-21 20:58:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95423   8 58563 75512035 A  ERROR'
2019-03-21 20:58:32 [DEBUG   ] Got command BAM from MCS: ref #95422
2019-03-21 20:58:32 [INFO    ] Finished processing BAM request
2019-03-21 20:58:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95422   8 58563 75512039 A  ERROR'
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 20:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 20:58:32 [DEBUG   ] spawn_process: at 2019-03-21 20:58:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 20:58:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 20:58:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:59:10 [DEBUG   ] Got command BAM from MCS: ref #95424
2019-03-21 20:59:10 [INFO    ] Finished processing BAM request
2019-03-21 20:59:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95424   8 58563 75550027 A  ERROR'
2019-03-21 20:59:10 [DEBUG   ] Got command BAM from MCS: ref #95425
2019-03-21 20:59:10 [INFO    ] Finished processing BAM request
2019-03-21 20:59:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95425   8 58563 75550031 A  ERROR'
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:59:10 [DEBUG   ] spawn_process: at 2019-03-21 20:59:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:59:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 20:59:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 20:59:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:59:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:59:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:59:26 [WARNING ] (13, 1, 'bot')
2019-03-21 20:59:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 20:59:26 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-03-21 20:59:37 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 20:59:48 [DEBUG   ] Got command BAM from MCS: ref #95426
2019-03-21 20:59:48 [INFO    ] Finished processing BAM request
2019-03-21 20:59:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:59:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95426   8 58563 75588035 A  ERROR'
2019-03-21 20:59:48 [DEBUG   ] Got command BAM from MCS: ref #95427
2019-03-21 20:59:48 [INFO    ] Finished processing BAM request
2019-03-21 20:59:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 20:59:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95427   8 58563 75588039 A  ERROR'
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 20:59:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 20:59:48 [DEBUG   ] spawn_process: at 2019-03-21 20:59:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 20:59:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:00:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:00:26 [DEBUG   ] Got command BAM from MCS: ref #95435
2019-03-21 21:00:26 [INFO    ] Finished processing BAM request
2019-03-21 21:00:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95435   8 58563 75626035 A  ERROR'
2019-03-21 21:00:26 [DEBUG   ] Got command BAM from MCS: ref #95434
2019-03-21 21:00:26 [INFO    ] Finished processing BAM request
2019-03-21 21:00:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95434   8 58563 75626039 A  ERROR'
2019-03-21 21:00:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:00:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:00:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:00:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:00:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:00:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:00:26 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:00:26 [DEBUG   ] spawn_process: at 2019-03-21 21:00:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:00:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-03-21 21:00:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:01:04 [DEBUG   ] Got command BAM from MCS: ref #95436
2019-03-21 21:01:04 [INFO    ] Finished processing BAM request
2019-03-21 21:01:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95436   8 58563 75664035 A  ERROR'
2019-03-21 21:01:04 [DEBUG   ] Got command BAM from MCS: ref #95437
2019-03-21 21:01:04 [INFO    ] Finished processing BAM request
2019-03-21 21:01:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:01:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95437   8 58563 75664039 A  ERROR'
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:01:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:01:04 [DEBUG   ] spawn_process: at 2019-03-21 21:01:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:01:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-21 21:01:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:01:26 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:01:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 21:01:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:01:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:01:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:01:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:01:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:01:26 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-03-21 21:01:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:01:42 [DEBUG   ] Got command BAM from MCS: ref #95439
2019-03-21 21:01:42 [INFO    ] Finished processing BAM request
2019-03-21 21:01:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95439   8 58563 75702031 A  ERROR'
2019-03-21 21:01:42 [DEBUG   ] Got command BAM from MCS: ref #95438
2019-03-21 21:01:42 [INFO    ] Finished processing BAM request
2019-03-21 21:01:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95438   8 58563 75702035 A  ERROR'
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:01:42 [DEBUG   ] spawn_process: at 2019-03-21 21:01:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:01:46 [DEBUG   ] Got command RPT from MCS: ref #95440
2019-03-21 21:01:46 [DEBUG   ] summary = ERROR
2019-03-21 21:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95440  13 58563 75706319 A  ERRORERROR'
2019-03-21 21:01:46 [DEBUG   ] Got command RPT from MCS: ref #95441
2019-03-21 21:01:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95441  77 58563 75706511 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:01:46 [DEBUG   ] Got command RPT from MCS: ref #95442
2019-03-21 21:01:46 [DEBUG   ] summary = ERROR
2019-03-21 21:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95442  13 58563 75706715 A  ERRORERROR'
2019-03-21 21:01:46 [DEBUG   ] Got command RPT from MCS: ref #95443
2019-03-21 21:01:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95443  77 58563 75706919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:01:47 [DEBUG   ] Got command RPT from MCS: ref #95444
2019-03-21 21:01:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95444  12 58563 75707123 A  ERRORB›™š'
2019-03-21 21:01:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:02:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:02:21 [DEBUG   ] Got command BAM from MCS: ref #95445
2019-03-21 21:02:21 [INFO    ] Finished processing BAM request
2019-03-21 21:02:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95445   8 58563 75741031 A  ERROR'
2019-03-21 21:02:21 [DEBUG   ] Got command BAM from MCS: ref #95446
2019-03-21 21:02:21 [INFO    ] Finished processing BAM request
2019-03-21 21:02:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95446   8 58563 75741035 A  ERROR'
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:02:21 [DEBUG   ] spawn_process: at 2019-03-21 21:02:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:02:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:02:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 21:02:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:02:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:02:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:02:26 [WARNING ] (13, 1, 'bot')
2019-03-21 21:02:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:02:26 [DEBUG   ] Finished updating board flags in 0.977 seconds
2019-03-21 21:02:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 21:02:40 [DEBUG   ] Got command RPT from MCS: ref #95447
2019-03-21 21:02:40 [DEBUG   ] summary = ERROR
2019-03-21 21:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95447  13 58563 75760863 A  ERRORERROR'
2019-03-21 21:02:40 [DEBUG   ] Got command RPT from MCS: ref #95448
2019-03-21 21:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95448  77 58563 75760863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:02:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:03:00 [DEBUG   ] Got command BAM from MCS: ref #95471
2019-03-21 21:03:00 [INFO    ] Finished processing BAM request
2019-03-21 21:03:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95471   8 58563 75780031 A  ERROR'
2019-03-21 21:03:00 [DEBUG   ] Got command BAM from MCS: ref #95470
2019-03-21 21:03:00 [INFO    ] Finished processing BAM request
2019-03-21 21:03:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95470   8 58563 75780035 A  ERROR'
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:03:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:03:00 [DEBUG   ] spawn_process: at 2019-03-21 21:03:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:03:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:03:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 21:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:03:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:03:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:03:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:03:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:03:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:03:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:03:27 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-03-21 21:03:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 21:03:39 [DEBUG   ] Got command BAM from MCS: ref #95472
2019-03-21 21:03:39 [INFO    ] Finished processing BAM request
2019-03-21 21:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95472   8 58563 75819027 A  ERROR'
2019-03-21 21:03:39 [DEBUG   ] Got command BAM from MCS: ref #95473
2019-03-21 21:03:39 [INFO    ] Finished processing BAM request
2019-03-21 21:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95473   8 58563 75819031 A  ERROR'
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:03:39 [DEBUG   ] spawn_process: at 2019-03-21 21:03:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:03:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:04:18 [DEBUG   ] Got command BAM from MCS: ref #95474
2019-03-21 21:04:18 [INFO    ] Finished processing BAM request
2019-03-21 21:04:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95474   8 58563 75858031 A  ERROR'
2019-03-21 21:04:18 [DEBUG   ] Got command BAM from MCS: ref #95475
2019-03-21 21:04:18 [INFO    ] Finished processing BAM request
2019-03-21 21:04:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95475   8 58563 75858035 A  ERROR'
2019-03-21 21:04:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 21:04:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 21:04:18 [DEBUG   ] spawn_process: at 2019-03-21 21:04:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 21:04:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:04:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:04:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:04:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:04:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:04:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:04:27 [DEBUG   ] Finished updating board flags in 1.182 seconds
2019-03-21 21:04:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:04:57 [DEBUG   ] Got command BAM from MCS: ref #95477
2019-03-21 21:04:57 [INFO    ] Finished processing BAM request
2019-03-21 21:04:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95477   8 58563 75897035 A  ERROR'
2019-03-21 21:04:57 [DEBUG   ] Got command BAM from MCS: ref #95476
2019-03-21 21:04:57 [INFO    ] Finished processing BAM request
2019-03-21 21:04:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95476   8 58563 75897039 A  ERROR'
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:04:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:04:57 [DEBUG   ] spawn_process: at 2019-03-21 21:04:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:04:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:05:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:05:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:05:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:05:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:05:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:05:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:05:27 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-03-21 21:05:36 [DEBUG   ] Got command BAM from MCS: ref #95478
2019-03-21 21:05:36 [INFO    ] Finished processing BAM request
2019-03-21 21:05:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95478   8 58563 75936035 A  ERROR'
2019-03-21 21:05:36 [DEBUG   ] Got command BAM from MCS: ref #95479
2019-03-21 21:05:36 [INFO    ] Finished processing BAM request
2019-03-21 21:05:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95479   8 58563 75936039 A  ERROR'
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:05:36 [DEBUG   ] spawn_process: at 2019-03-21 21:05:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:05:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:05:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:06:15 [DEBUG   ] Got command BAM from MCS: ref #95487
2019-03-21 21:06:15 [INFO    ] Finished processing BAM request
2019-03-21 21:06:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95487   8 58563 75975027 A  ERROR'
2019-03-21 21:06:15 [DEBUG   ] Got command BAM from MCS: ref #95486
2019-03-21 21:06:15 [INFO    ] Finished processing BAM request
2019-03-21 21:06:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95486   8 58563 75975031 A  ERROR'
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:06:15 [DEBUG   ] spawn_process: at 2019-03-21 21:06:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:06:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:06:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:06:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:06:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:06:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:06:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:06:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:06:27 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-03-21 21:06:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:06:46 [DEBUG   ] Got command RPT from MCS: ref #95490
2019-03-21 21:06:46 [DEBUG   ] summary = ERROR
2019-03-21 21:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95490  13 58563 76006403 A  ERRORERROR'
2019-03-21 21:06:46 [DEBUG   ] Got command RPT from MCS: ref #95491
2019-03-21 21:06:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95491  77 58563 76006607 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:06:46 [DEBUG   ] Got command RPT from MCS: ref #95492
2019-03-21 21:06:46 [DEBUG   ] summary = ERROR
2019-03-21 21:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95492  13 58563 76006799 A  ERRORERROR'
2019-03-21 21:06:47 [DEBUG   ] Got command RPT from MCS: ref #95494
2019-03-21 21:06:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:06:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95494  77 58563 76007003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:06:47 [DEBUG   ] Got command RPT from MCS: ref #95496
2019-03-21 21:06:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:06:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95496  12 58563 76007213 A  ERRORBœ™š'
2019-03-21 21:06:55 [DEBUG   ] Got command BAM from MCS: ref #95500
2019-03-21 21:06:55 [INFO    ] Finished processing BAM request
2019-03-21 21:06:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95500   8 58563 76015027 A  ERROR'
2019-03-21 21:06:55 [DEBUG   ] Got command BAM from MCS: ref #95501
2019-03-21 21:06:55 [INFO    ] Finished processing BAM request
2019-03-21 21:06:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95501   8 58563 76015031 A  ERROR'
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:06:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:06:55 [DEBUG   ] spawn_process: at 2019-03-21 21:06:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:06:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:07:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:07:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:07:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:07:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:07:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:07:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:07:27 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-03-21 21:07:35 [DEBUG   ] Got command BAM from MCS: ref #95502
2019-03-21 21:07:35 [INFO    ] Finished processing BAM request
2019-03-21 21:07:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95502   8 58563 76055027 A  ERROR'
2019-03-21 21:07:35 [DEBUG   ] Got command BAM from MCS: ref #95503
2019-03-21 21:07:35 [INFO    ] Finished processing BAM request
2019-03-21 21:07:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95503   8 58563 76055031 A  ERROR'
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 21:07:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 21:07:35 [DEBUG   ] spawn_process: at 2019-03-21 21:07:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 21:07:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:07:40 [DEBUG   ] Got command RPT from MCS: ref #95504
2019-03-21 21:07:40 [DEBUG   ] summary = ERROR
2019-03-21 21:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95504  13 58563 76060867 A  ERRORERROR'
2019-03-21 21:07:40 [DEBUG   ] Got command RPT from MCS: ref #95505
2019-03-21 21:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95505  77 58563 76060867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:07:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:08:15 [DEBUG   ] Got command BAM from MCS: ref #95521
2019-03-21 21:08:15 [INFO    ] Finished processing BAM request
2019-03-21 21:08:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95521   8 58563 76095035 A  ERROR'
2019-03-21 21:08:15 [DEBUG   ] Got command BAM from MCS: ref #95522
2019-03-21 21:08:15 [INFO    ] Finished processing BAM request
2019-03-21 21:08:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95522   8 58563 76095039 A  ERROR'
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 21:08:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 21:08:15 [DEBUG   ] spawn_process: at 2019-03-21 21:08:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 21:08:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:08:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:08:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:08:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:08:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:08:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:08:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:08:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:08:28 [DEBUG   ] Finished updating board flags in 2.049 seconds
2019-03-21 21:08:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 21:08:55 [DEBUG   ] Got command BAM from MCS: ref #95530
2019-03-21 21:08:55 [INFO    ] Finished processing BAM request
2019-03-21 21:08:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95530   8 58563 76135035 A  ERROR'
2019-03-21 21:08:55 [DEBUG   ] Got command BAM from MCS: ref #95529
2019-03-21 21:08:55 [INFO    ] Finished processing BAM request
2019-03-21 21:08:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:08:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95529   8 58563 76135039 A  ERROR'
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:08:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:08:55 [DEBUG   ] spawn_process: at 2019-03-21 21:08:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:08:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:09:19 [DEBUG   ] Finished updating ant stats in 1.803 seconds
2019-03-21 21:09:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:09:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:09:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:09:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:09:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:09:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:09:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:09:27 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-03-21 21:09:35 [DEBUG   ] Got command BAM from MCS: ref #95531
2019-03-21 21:09:35 [INFO    ] Finished processing BAM request
2019-03-21 21:09:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:09:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95531   8 58563 76175031 A  ERROR'
2019-03-21 21:09:35 [DEBUG   ] Got command BAM from MCS: ref #95532
2019-03-21 21:09:35 [INFO    ] Finished processing BAM request
2019-03-21 21:09:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:09:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95532   8 58563 76175035 A  ERROR'
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 21:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 21:09:35 [DEBUG   ] spawn_process: at 2019-03-21 21:09:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 21:09:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:09:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:10:15 [DEBUG   ] Got command BAM from MCS: ref #95533
2019-03-21 21:10:15 [INFO    ] Finished processing BAM request
2019-03-21 21:10:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95533   8 58563 76215035 A  ERROR'
2019-03-21 21:10:15 [DEBUG   ] Got command BAM from MCS: ref #95534
2019-03-21 21:10:15 [INFO    ] Finished processing BAM request
2019-03-21 21:10:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95534   8 58563 76215039 A  ERROR'
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:10:15 [DEBUG   ] spawn_process: at 2019-03-21 21:10:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:10:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:10:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:10:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:10:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:10:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:10:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:10:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:10:27 [DEBUG   ] Finished updating board flags in 1.238 seconds
2019-03-21 21:10:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:10:55 [DEBUG   ] Got command BAM from MCS: ref #95535
2019-03-21 21:10:55 [INFO    ] Finished processing BAM request
2019-03-21 21:10:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:10:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95535   8 58563 76255031 A  ERROR'
2019-03-21 21:10:55 [DEBUG   ] Got command BAM from MCS: ref #95536
2019-03-21 21:10:55 [INFO    ] Finished processing BAM request
2019-03-21 21:10:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:10:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95536   8 58563 76255039 A  ERROR'
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:10:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:10:55 [DEBUG   ] spawn_process: at 2019-03-21 21:10:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:10:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:11:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:11:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:11:27 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:11:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:11:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:11:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:11:27 [WARNING ] (13, 1, 'bot')
2019-03-21 21:11:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:11:27 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-03-21 21:11:36 [DEBUG   ] Got command BAM from MCS: ref #95537
2019-03-21 21:11:36 [INFO    ] Finished processing BAM request
2019-03-21 21:11:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95537   8 58563 76296031 A  ERROR'
2019-03-21 21:11:36 [DEBUG   ] Got command BAM from MCS: ref #95538
2019-03-21 21:11:36 [INFO    ] Finished processing BAM request
2019-03-21 21:11:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95538   8 58563 76296035 A  ERROR'
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 21:11:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 21:11:36 [DEBUG   ] spawn_process: at 2019-03-21 21:11:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 21:11:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:11:46 [DEBUG   ] Got command RPT from MCS: ref #95539
2019-03-21 21:11:46 [DEBUG   ] summary = ERROR
2019-03-21 21:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95539  13 58563 76306487 A  ERRORERROR'
2019-03-21 21:11:46 [DEBUG   ] Got command RPT from MCS: ref #95540
2019-03-21 21:11:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95540  77 58563 76306691 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:11:46 [DEBUG   ] Got command RPT from MCS: ref #95541
2019-03-21 21:11:46 [DEBUG   ] summary = ERROR
2019-03-21 21:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95541  13 58563 76306883 A  ERRORERROR'
2019-03-21 21:11:47 [DEBUG   ] Got command RPT from MCS: ref #95542
2019-03-21 21:11:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:11:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95542  77 58563 76307087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:11:47 [DEBUG   ] Got command RPT from MCS: ref #95543
2019-03-21 21:11:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:11:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95543  12 58563 76307291 A  ERRORB›™š'
2019-03-21 21:11:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:12:17 [DEBUG   ] Got command BAM from MCS: ref #95551
2019-03-21 21:12:17 [INFO    ] Finished processing BAM request
2019-03-21 21:12:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95551   8 58563 76337027 A  ERROR'
2019-03-21 21:12:17 [DEBUG   ] Got command BAM from MCS: ref #95550
2019-03-21 21:12:17 [INFO    ] Finished processing BAM request
2019-03-21 21:12:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95550   8 58563 76337031 A  ERROR'
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 21:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 21:12:17 [DEBUG   ] spawn_process: at 2019-03-21 21:12:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 21:12:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 21:12:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:12:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:12:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:12:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:12:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:12:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:12:28 [DEBUG   ] Finished updating board flags in 1.538 seconds
2019-03-21 21:12:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 21:12:40 [DEBUG   ] Got command RPT from MCS: ref #95552
2019-03-21 21:12:40 [DEBUG   ] summary = ERROR
2019-03-21 21:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95552  13 58563 76360863 A  ERRORERROR'
2019-03-21 21:12:40 [DEBUG   ] Got command RPT from MCS: ref #95553
2019-03-21 21:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95553  77 58563 76360863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:12:58 [DEBUG   ] Got command BAM from MCS: ref #95570
2019-03-21 21:12:58 [INFO    ] Finished processing BAM request
2019-03-21 21:12:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:12:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95570   8 58563 76378027 A  ERROR'
2019-03-21 21:12:58 [DEBUG   ] Got command BAM from MCS: ref #95569
2019-03-21 21:12:58 [INFO    ] Finished processing BAM request
2019-03-21 21:12:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:12:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95569   8 58563 76378031 A  ERROR'
2019-03-21 21:12:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:12:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:12:58 [DEBUG   ] spawn_process: at 2019-03-21 21:12:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:13:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:13:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:13:28 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:13:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:13:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:13:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:13:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:13:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:13:28 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-03-21 21:13:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 21:13:39 [DEBUG   ] Got command BAM from MCS: ref #95572
2019-03-21 21:13:39 [INFO    ] Finished processing BAM request
2019-03-21 21:13:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95572   8 58563 76419027 A  ERROR'
2019-03-21 21:13:39 [DEBUG   ] Got command BAM from MCS: ref #95571
2019-03-21 21:13:39 [INFO    ] Finished processing BAM request
2019-03-21 21:13:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95571   8 58563 76419031 A  ERROR'
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 21:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 21:13:39 [DEBUG   ] spawn_process: at 2019-03-21 21:13:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 21:13:58 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 21:14:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:14:20 [DEBUG   ] Got command BAM from MCS: ref #95574
2019-03-21 21:14:20 [INFO    ] Finished processing BAM request
2019-03-21 21:14:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95574   8 58563 76460027 A  ERROR'
2019-03-21 21:14:20 [DEBUG   ] Got command BAM from MCS: ref #95573
2019-03-21 21:14:20 [INFO    ] Finished processing BAM request
2019-03-21 21:14:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95573   8 58563 76460031 A  ERROR'
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:14:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:14:20 [DEBUG   ] spawn_process: at 2019-03-21 21:14:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:14:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 21:14:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:14:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:14:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:14:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:14:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:14:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:14:28 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-03-21 21:14:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:14:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:15:00 [DEBUG   ] Got command STP from MCS: ref #95581
2019-03-21 21:15:00 [INFO    ] Finished processing BAM request
2019-03-21 21:15:00 [INFO    ] Shutdown the adder chain on beam #2
2019-03-21 21:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    95581   8 58563 76500031 A  ERROR'
2019-03-21 21:15:00 [DEBUG   ] Got command STP from MCS: ref #95582
2019-03-21 21:15:00 [INFO    ] Finished processing BAM request
2019-03-21 21:15:00 [INFO    ] Shutdown the adder chain on beam #3
2019-03-21 21:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    95582   8 58563 76500035 A  ERROR'
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 21:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 21:15:00 [DEBUG   ] spawn_process: at 2019-03-21 21:15:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 21:15:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:15:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:15:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:15:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:15:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:15:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:15:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:15:28 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-03-21 21:15:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:15:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:16:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:16:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:16:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:16:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:16:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:16:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:16:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:16:28 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-03-21 21:16:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 21:16:46 [DEBUG   ] Got command RPT from MCS: ref #95585
2019-03-21 21:16:46 [DEBUG   ] summary = ERROR
2019-03-21 21:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95585  13 58563 76606575 A  ERRORERROR'
2019-03-21 21:16:46 [DEBUG   ] Got command RPT from MCS: ref #95586
2019-03-21 21:16:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95586  77 58563 76606767 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:16:46 [DEBUG   ] Got command RPT from MCS: ref #95587
2019-03-21 21:16:46 [DEBUG   ] summary = ERROR
2019-03-21 21:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95587  13 58563 76606971 A  ERRORERROR'
2019-03-21 21:16:47 [DEBUG   ] Got command RPT from MCS: ref #95589
2019-03-21 21:16:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:16:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95589  77 58563 76607175 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:16:47 [DEBUG   ] Got command RPT from MCS: ref #95591
2019-03-21 21:16:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:16:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95591  12 58563 76607379 A  ERRORB–™š'
2019-03-21 21:16:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 21:17:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:17:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:17:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:17:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:17:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:17:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:17:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:17:28 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-03-21 21:17:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:17:40 [DEBUG   ] Got command RPT from MCS: ref #95595
2019-03-21 21:17:40 [DEBUG   ] summary = ERROR
2019-03-21 21:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95595  13 58563 76660863 A  ERRORERROR'
2019-03-21 21:17:40 [DEBUG   ] Got command RPT from MCS: ref #95596
2019-03-21 21:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95596  77 58563 76660863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:17:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 21:18:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:18:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:18:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:18:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:18:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:18:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:18:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:18:29 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-03-21 21:18:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:18:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:19:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:19:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-21 21:19:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:19:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:19:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:19:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:19:28 [DEBUG   ] Finished updating board flags in 1.028 seconds
2019-03-21 21:19:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:19:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:20:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:20:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:20:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:20:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:20:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:20:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:20:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:20:29 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-03-21 21:20:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:20:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:21:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:21:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:21:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:21:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:21:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:21:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:21:28 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-03-21 21:21:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 21:21:46 [DEBUG   ] Got command RPT from MCS: ref #95624
2019-03-21 21:21:46 [DEBUG   ] summary = ERROR
2019-03-21 21:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95624  13 58563 76906663 A  ERRORERROR'
2019-03-21 21:21:46 [DEBUG   ] Got command RPT from MCS: ref #95625
2019-03-21 21:21:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95625  77 58563 76906855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:21:47 [DEBUG   ] Got command RPT from MCS: ref #95626
2019-03-21 21:21:47 [DEBUG   ] summary = ERROR
2019-03-21 21:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95626  13 58563 76907059 A  ERRORERROR'
2019-03-21 21:21:47 [DEBUG   ] Got command RPT from MCS: ref #95627
2019-03-21 21:21:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95627  77 58563 76907263 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:21:47 [DEBUG   ] Got command RPT from MCS: ref #95628
2019-03-21 21:21:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95628  12 58563 76907467 A  ERRORB’™š'
2019-03-21 21:21:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:22:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:22:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:22:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:22:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:22:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:22:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:22:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:22:28 [DEBUG   ] Finished updating board flags in 1.227 seconds
2019-03-21 21:22:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:22:40 [DEBUG   ] Got command RPT from MCS: ref #95629
2019-03-21 21:22:40 [DEBUG   ] summary = ERROR
2019-03-21 21:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95629  13 58563 76960863 A  ERRORERROR'
2019-03-21 21:22:40 [DEBUG   ] Got command RPT from MCS: ref #95630
2019-03-21 21:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95630  77 58563 76960863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:22:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:23:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:23:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:23:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:23:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:23:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:23:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:23:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:23:28 [DEBUG   ] Finished updating board flags in 1.209 seconds
2019-03-21 21:23:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-03-21 21:23:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:24:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:24:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:24:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:24:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:24:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:24:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:24:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:24:29 [DEBUG   ] Finished updating board flags in 1.741 seconds
2019-03-21 21:24:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-03-21 21:24:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:25:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:25:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:25:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:25:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:25:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:25:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:25:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:25:28 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-03-21 21:25:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:25:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:26:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:26:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:26:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:26:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:26:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:26:28 [WARNING ] (13, 1, 'bot')
2019-03-21 21:26:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:26:28 [DEBUG   ] Finished updating board flags in 1.097 seconds
2019-03-21 21:26:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:26:46 [DEBUG   ] Got command RPT from MCS: ref #95654
2019-03-21 21:26:46 [DEBUG   ] summary = ERROR
2019-03-21 21:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95654  13 58563 77206739 A  ERRORERROR'
2019-03-21 21:26:46 [DEBUG   ] Got command RPT from MCS: ref #95655
2019-03-21 21:26:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95655  77 58563 77206943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:26:47 [DEBUG   ] Got command RPT from MCS: ref #95656
2019-03-21 21:26:47 [DEBUG   ] summary = ERROR
2019-03-21 21:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95656  13 58563 77207147 A  ERRORERROR'
2019-03-21 21:26:47 [DEBUG   ] Got command RPT from MCS: ref #95658
2019-03-21 21:26:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95658  77 58563 77207351 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:26:47 [DEBUG   ] Got command RPT from MCS: ref #95659
2019-03-21 21:26:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95659  12 58563 77207543 A  ERRORB‘™š'
2019-03-21 21:26:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:27:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:27:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:27:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:27:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:27:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:27:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:27:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:27:29 [DEBUG   ] Finished updating board flags in 1.545 seconds
2019-03-21 21:27:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:27:40 [DEBUG   ] Got command RPT from MCS: ref #95670
2019-03-21 21:27:40 [DEBUG   ] summary = ERROR
2019-03-21 21:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95670  13 58563 77260863 A  ERRORERROR'
2019-03-21 21:27:40 [DEBUG   ] Got command RPT from MCS: ref #95671
2019-03-21 21:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95671  77 58563 77260863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:27:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:28:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:28:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:28:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:28:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:28:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:28:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:28:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:28:29 [DEBUG   ] Finished updating board flags in 1.324 seconds
2019-03-21 21:28:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:28:59 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 21:29:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:29:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:29:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:29:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:29:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:29:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:29:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:29:29 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-03-21 21:29:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:29:58 [DEBUG   ] Got command DRX from MCS: ref #95697
2019-03-21 21:29:58 [INFO    ] sending drx command to lwa16
2019-03-21 21:29:58 [DEBUG   ] run_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 58000000.0 7 8 0']
2019-03-21 21:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    95697   8 58563 77398015 A  ERROR'
2019-03-21 21:29:58 [DEBUG   ] Got command DRX from MCS: ref #95698
2019-03-21 21:29:58 [INFO    ] sending drx command to lwa34
2019-03-21 21:29:58 [DEBUG   ] run_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 24000000.0 7 8 0']
2019-03-21 21:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    95698   8 58563 77398019 A  ERROR'
2019-03-21 21:29:58 [DEBUG   ] Got command DRX from MCS: ref #95699
2019-03-21 21:29:58 [INFO    ] sending drx command to lwa16
2019-03-21 21:29:58 [DEBUG   ] run_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 75000000.0 7 8 0']
2019-03-21 21:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    95699   8 58563 77398023 A  ERROR'
2019-03-21 21:29:58 [DEBUG   ] Got command DRX from MCS: ref #95700
2019-03-21 21:29:58 [INFO    ] sending drx command to lwa34
2019-03-21 21:29:58 [DEBUG   ] run_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 41000000.0 7 8 0']
2019-03-21 21:29:58 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-21 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    95700   8 58563 77398027 A  ERROR'
2019-03-21 21:29:58 [DEBUG   ] Got command BAM from MCS: ref #95701
2019-03-21 21:29:58 [INFO    ] Finished processing BAM request
2019-03-21 21:29:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95701   8 58563 77398031 A  ERROR'
2019-03-21 21:29:58 [DEBUG   ] Got command BAM from MCS: ref #95702
2019-03-21 21:29:58 [INFO    ] Finished processing BAM request
2019-03-21 21:29:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95702   8 58563 77398035 A  ERROR'
2019-03-21 21:29:58 [INFO    ] Finished starting DRX
2019-03-21 21:29:58 [INFO    ] Finished starting DRX
2019-03-21 21:29:58 [INFO    ] Finished starting DRX
2019-03-21 21:29:58 [INFO    ] Finished starting DRX
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:29:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:29:58 [DEBUG   ] spawn_process: at 2019-03-21 21:29:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:30:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:30:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:30:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:30:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:30:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:30:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:30:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:30:29 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-03-21 21:30:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 21:31:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:31:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:31:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:31:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:31:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:31:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:31:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:31:29 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-03-21 21:31:38 [DEBUG   ] Got command BAM from MCS: ref #95706
2019-03-21 21:31:38 [INFO    ] Finished processing BAM request
2019-03-21 21:31:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95706   8 58563 77498031 A  ERROR'
2019-03-21 21:31:38 [DEBUG   ] Got command BAM from MCS: ref #95705
2019-03-21 21:31:38 [INFO    ] Finished processing BAM request
2019-03-21 21:31:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95705   8 58563 77498035 A  ERROR'
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:31:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:31:38 [DEBUG   ] spawn_process: at 2019-03-21 21:31:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:31:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:31:46 [DEBUG   ] Got command RPT from MCS: ref #95707
2019-03-21 21:31:46 [DEBUG   ] summary = ERROR
2019-03-21 21:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95707  13 58563 77506831 A  ERRORERROR'
2019-03-21 21:31:47 [DEBUG   ] Got command RPT from MCS: ref #95708
2019-03-21 21:31:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95708  77 58563 77507035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:31:47 [DEBUG   ] Got command RPT from MCS: ref #95709
2019-03-21 21:31:47 [DEBUG   ] summary = ERROR
2019-03-21 21:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95709  13 58563 77507227 A  ERRORERROR'
2019-03-21 21:31:47 [DEBUG   ] Got command RPT from MCS: ref #95710
2019-03-21 21:31:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95710  77 58563 77507435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:31:47 [DEBUG   ] Got command RPT from MCS: ref #95711
2019-03-21 21:31:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95711  12 58563 77507627 A  ERRORB˜™š'
2019-03-21 21:32:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:32:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:32:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:32:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:32:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:32:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:32:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:32:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:32:29 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-03-21 21:32:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:32:40 [DEBUG   ] Got command RPT from MCS: ref #95712
2019-03-21 21:32:40 [DEBUG   ] summary = ERROR
2019-03-21 21:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95712  13 58563 77560863 A  ERRORERROR'
2019-03-21 21:32:40 [DEBUG   ] Got command RPT from MCS: ref #95713
2019-03-21 21:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95713  77 58563 77560863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:33:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:33:18 [DEBUG   ] Got command BAM from MCS: ref #95736
2019-03-21 21:33:18 [INFO    ] Finished processing BAM request
2019-03-21 21:33:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95736   8 58563 77598031 A  ERROR'
2019-03-21 21:33:18 [DEBUG   ] Got command BAM from MCS: ref #95735
2019-03-21 21:33:18 [INFO    ] Finished processing BAM request
2019-03-21 21:33:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95735   8 58563 77598035 A  ERROR'
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:33:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:33:18 [DEBUG   ] spawn_process: at 2019-03-21 21:33:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:33:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:33:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:33:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:33:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:33:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:33:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:33:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:33:30 [DEBUG   ] Finished updating board flags in 2.060 seconds
2019-03-21 21:33:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:34:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:34:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 21:34:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:34:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:34:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:34:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:34:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:34:29 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-03-21 21:34:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:34:58 [DEBUG   ] Got command BAM from MCS: ref #95737
2019-03-21 21:34:58 [INFO    ] Finished processing BAM request
2019-03-21 21:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95737   8 58563 77698035 A  ERROR'
2019-03-21 21:34:58 [DEBUG   ] Got command BAM from MCS: ref #95738
2019-03-21 21:34:58 [INFO    ] Finished processing BAM request
2019-03-21 21:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95738   8 58563 77698039 A  ERROR'
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 21:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 21:34:58 [DEBUG   ] spawn_process: at 2019-03-21 21:34:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 21:35:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:35:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:35:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:35:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:35:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:35:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:35:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:35:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:35:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:35:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:35:29 [DEBUG   ] Finished updating board flags in 1.246 seconds
2019-03-21 21:35:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 21:35:44 [DEBUG   ] Got command BAM from MCS: ref #95741
2019-03-21 21:35:44 [INFO    ] Finished processing BAM request
2019-03-21 21:35:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95741   8 58563 77744031 A  ERROR'
2019-03-21 21:35:44 [DEBUG   ] Got command BAM from MCS: ref #95742
2019-03-21 21:35:44 [INFO    ] Finished processing BAM request
2019-03-21 21:35:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95742   8 58563 77744035 A  ERROR'
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:35:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:35:44 [DEBUG   ] spawn_process: at 2019-03-21 21:35:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:36:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 21:36:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:36:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:36:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:36:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:36:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:36:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:36:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:36:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:36:29 [DEBUG   ] Finished updating board flags in 1.178 seconds
2019-03-21 21:36:30 [DEBUG   ] Got command BAM from MCS: ref #95749
2019-03-21 21:36:30 [INFO    ] Finished processing BAM request
2019-03-21 21:36:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95749   8 58563 77790031 A  ERROR'
2019-03-21 21:36:30 [DEBUG   ] Got command BAM from MCS: ref #95750
2019-03-21 21:36:30 [INFO    ] Finished processing BAM request
2019-03-21 21:36:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95750   8 58563 77790035 A  ERROR'
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:36:30 [DEBUG   ] spawn_process: at 2019-03-21 21:36:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:36:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:36:46 [DEBUG   ] Got command RPT from MCS: ref #95753
2019-03-21 21:36:46 [DEBUG   ] summary = ERROR
2019-03-21 21:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95753  13 58563 77806919 A  ERRORERROR'
2019-03-21 21:36:47 [DEBUG   ] Got command RPT from MCS: ref #95754
2019-03-21 21:36:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:36:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95754  77 58563 77807111 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:36:47 [DEBUG   ] Got command RPT from MCS: ref #95755
2019-03-21 21:36:47 [DEBUG   ] summary = ERROR
2019-03-21 21:36:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95755  13 58563 77807315 A  ERRORERROR'
2019-03-21 21:36:47 [DEBUG   ] Got command RPT from MCS: ref #95757
2019-03-21 21:36:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:36:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95757  77 58563 77807519 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:36:47 [DEBUG   ] Got command RPT from MCS: ref #95758
2019-03-21 21:36:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:36:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95758  12 58563 77807711 A  ERRORBš™š'
2019-03-21 21:37:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:37:16 [DEBUG   ] Got command BAM from MCS: ref #95764
2019-03-21 21:37:16 [INFO    ] Finished processing BAM request
2019-03-21 21:37:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95764   8 58563 77836031 A  ERROR'
2019-03-21 21:37:16 [DEBUG   ] Got command BAM from MCS: ref #95763
2019-03-21 21:37:16 [INFO    ] Finished processing BAM request
2019-03-21 21:37:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:37:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95763   8 58563 77836035 A  ERROR'
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:37:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:37:16 [DEBUG   ] spawn_process: at 2019-03-21 21:37:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:37:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 21:37:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:37:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:37:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:37:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:37:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:37:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:37:29 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-03-21 21:37:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:37:40 [DEBUG   ] Got command RPT from MCS: ref #95765
2019-03-21 21:37:40 [DEBUG   ] summary = ERROR
2019-03-21 21:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95765  13 58563 77860867 A  ERRORERROR'
2019-03-21 21:37:40 [DEBUG   ] Got command RPT from MCS: ref #95766
2019-03-21 21:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95766  77 58563 77860867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:38:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:38:03 [DEBUG   ] Got command BAM from MCS: ref #95782
2019-03-21 21:38:03 [INFO    ] Finished processing BAM request
2019-03-21 21:38:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:38:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95782   8 58563 77883031 A  ERROR'
2019-03-21 21:38:03 [DEBUG   ] Got command BAM from MCS: ref #95783
2019-03-21 21:38:03 [INFO    ] Finished processing BAM request
2019-03-21 21:38:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:38:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95783   8 58563 77883035 A  ERROR'
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:38:03 [DEBUG   ] spawn_process: at 2019-03-21 21:38:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:38:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 21:38:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:38:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:38:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:38:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:38:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:38:29 [WARNING ] (13, 1, 'bot')
2019-03-21 21:38:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:38:29 [DEBUG   ] Finished updating board flags in 0.966 seconds
2019-03-21 21:38:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 21:38:50 [DEBUG   ] Got command BAM from MCS: ref #95787
2019-03-21 21:38:50 [INFO    ] Finished processing BAM request
2019-03-21 21:38:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95787   8 58563 77930031 A  ERROR'
2019-03-21 21:38:50 [DEBUG   ] Got command BAM from MCS: ref #95786
2019-03-21 21:38:50 [INFO    ] Finished processing BAM request
2019-03-21 21:38:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95786   8 58563 77930035 A  ERROR'
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:38:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:38:50 [DEBUG   ] spawn_process: at 2019-03-21 21:38:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:39:00 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 21:39:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 21:39:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:39:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 21:39:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:39:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:39:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:39:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:39:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:39:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:39:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:39:30 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-03-21 21:39:37 [DEBUG   ] Got command BAM from MCS: ref #95792
2019-03-21 21:39:37 [INFO    ] Finished processing BAM request
2019-03-21 21:39:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95792   8 58563 77977039 A  ERROR'
2019-03-21 21:39:37 [DEBUG   ] Got command BAM from MCS: ref #95793
2019-03-21 21:39:37 [INFO    ] Finished processing BAM request
2019-03-21 21:39:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95793   8 58563 77977047 A  ERROR'
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:39:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:39:37 [DEBUG   ] spawn_process: at 2019-03-21 21:39:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:39:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:40:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:40:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 21:40:24 [DEBUG   ] Got command BAM from MCS: ref #95794
2019-03-21 21:40:24 [INFO    ] Finished processing BAM request
2019-03-21 21:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95794   8 58563 78024027 A  ERROR'
2019-03-21 21:40:24 [DEBUG   ] Got command BAM from MCS: ref #95795
2019-03-21 21:40:24 [INFO    ] Finished processing BAM request
2019-03-21 21:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95795   8 58563 78024031 A  ERROR'
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:40:24 [DEBUG   ] spawn_process: at 2019-03-21 21:40:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:40:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:40:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:40:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:40:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:40:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:40:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:40:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:40:30 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-03-21 21:40:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 21:41:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 21:41:11 [DEBUG   ] Got command BAM from MCS: ref #95796
2019-03-21 21:41:11 [INFO    ] Finished processing BAM request
2019-03-21 21:41:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95796   8 58563 78071035 A  ERROR'
2019-03-21 21:41:11 [DEBUG   ] Got command BAM from MCS: ref #95797
2019-03-21 21:41:11 [INFO    ] Finished processing BAM request
2019-03-21 21:41:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95797   8 58563 78071039 A  ERROR'
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 21:41:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 21:41:11 [DEBUG   ] spawn_process: at 2019-03-21 21:41:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 21:41:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:41:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:41:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:41:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:41:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:41:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:41:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:41:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:41:30 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-03-21 21:41:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:41:46 [DEBUG   ] Got command RPT from MCS: ref #95798
2019-03-21 21:41:46 [DEBUG   ] summary = ERROR
2019-03-21 21:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95798  13 58563 78106999 A  ERRORERROR'
2019-03-21 21:41:47 [DEBUG   ] Got command RPT from MCS: ref #95799
2019-03-21 21:41:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:41:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95799  77 58563 78107203 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:41:47 [DEBUG   ] Got command RPT from MCS: ref #95800
2019-03-21 21:41:47 [DEBUG   ] summary = ERROR
2019-03-21 21:41:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95800  13 58563 78107407 A  ERRORERROR'
2019-03-21 21:41:47 [DEBUG   ] Got command RPT from MCS: ref #95801
2019-03-21 21:41:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:41:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95801  77 58563 78107599 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:41:47 [DEBUG   ] Got command RPT from MCS: ref #95802
2019-03-21 21:41:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:41:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95802  12 58563 78107803 A  ERRORBœ™š'
2019-03-21 21:41:59 [DEBUG   ] Got command BAM from MCS: ref #95810
2019-03-21 21:41:59 [INFO    ] Finished processing BAM request
2019-03-21 21:41:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95810   8 58563 78119027 A  ERROR'
2019-03-21 21:41:59 [DEBUG   ] Got command BAM from MCS: ref #95809
2019-03-21 21:41:59 [INFO    ] Finished processing BAM request
2019-03-21 21:41:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95809   8 58563 78119031 A  ERROR'
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 21:41:59 [DEBUG   ] spawn_process: at 2019-03-21 21:41:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 21:42:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:42:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:42:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:42:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:42:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:42:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:42:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:42:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:42:30 [DEBUG   ] Finished updating board flags in 1.234 seconds
2019-03-21 21:42:40 [DEBUG   ] Got command RPT from MCS: ref #95811
2019-03-21 21:42:40 [DEBUG   ] summary = ERROR
2019-03-21 21:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95811  13 58563 78160867 A  ERRORERROR'
2019-03-21 21:42:40 [DEBUG   ] Got command RPT from MCS: ref #95812
2019-03-21 21:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95812  77 58563 78160867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:42:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:42:47 [DEBUG   ] Got command BAM from MCS: ref #95828
2019-03-21 21:42:47 [INFO    ] Finished processing BAM request
2019-03-21 21:42:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:42:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95828   8 58563 78167027 A  ERROR'
2019-03-21 21:42:47 [DEBUG   ] Got command BAM from MCS: ref #95829
2019-03-21 21:42:47 [INFO    ] Finished processing BAM request
2019-03-21 21:42:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:42:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95829   8 58563 78167031 A  ERROR'
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 21:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 21:42:47 [DEBUG   ] spawn_process: at 2019-03-21 21:42:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 21:43:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:43:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:43:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:43:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:43:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:43:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:43:30 [DEBUG   ] Finished updating board flags in 1.205 seconds
2019-03-21 21:43:35 [DEBUG   ] Got command BAM from MCS: ref #95831
2019-03-21 21:43:35 [INFO    ] Finished processing BAM request
2019-03-21 21:43:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95831   8 58563 78215031 A  ERROR'
2019-03-21 21:43:35 [DEBUG   ] Got command BAM from MCS: ref #95830
2019-03-21 21:43:35 [INFO    ] Finished processing BAM request
2019-03-21 21:43:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95830   8 58563 78215035 A  ERROR'
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:43:35 [DEBUG   ] spawn_process: at 2019-03-21 21:43:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:43:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 21:44:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:44:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:44:23 [DEBUG   ] Got command BAM from MCS: ref #95832
2019-03-21 21:44:23 [INFO    ] Finished processing BAM request
2019-03-21 21:44:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95832   8 58563 78263031 A  ERROR'
2019-03-21 21:44:23 [DEBUG   ] Got command BAM from MCS: ref #95833
2019-03-21 21:44:23 [INFO    ] Finished processing BAM request
2019-03-21 21:44:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95833   8 58563 78263035 A  ERROR'
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:44:23 [DEBUG   ] spawn_process: at 2019-03-21 21:44:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:44:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:44:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:44:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:44:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:44:30 [DEBUG   ] Finished updating board flags in 1.162 seconds
2019-03-21 21:44:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:45:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:45:11 [DEBUG   ] Got command BAM from MCS: ref #95840
2019-03-21 21:45:11 [INFO    ] Finished processing BAM request
2019-03-21 21:45:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95840   8 58563 78311035 A  ERROR'
2019-03-21 21:45:11 [DEBUG   ] Got command BAM from MCS: ref #95841
2019-03-21 21:45:11 [INFO    ] Finished processing BAM request
2019-03-21 21:45:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95841   8 58563 78311039 A  ERROR'
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 21:45:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 21:45:11 [DEBUG   ] spawn_process: at 2019-03-21 21:45:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 21:45:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:45:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:45:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:45:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:45:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:45:30 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-03-21 21:45:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 21:46:00 [DEBUG   ] Got command BAM from MCS: ref #95843
2019-03-21 21:46:00 [INFO    ] Finished processing BAM request
2019-03-21 21:46:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95843   8 58563 78360027 A  ERROR'
2019-03-21 21:46:00 [DEBUG   ] Got command BAM from MCS: ref #95842
2019-03-21 21:46:00 [INFO    ] Finished processing BAM request
2019-03-21 21:46:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95842   8 58563 78360031 A  ERROR'
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:46:00 [DEBUG   ] spawn_process: at 2019-03-21 21:46:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:46:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:46:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:46:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:46:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 21:46:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:46:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:46:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:46:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:46:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:46:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:46:30 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-03-21 21:46:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:46:47 [DEBUG   ] Got command RPT from MCS: ref #95846
2019-03-21 21:46:47 [DEBUG   ] summary = ERROR
2019-03-21 21:46:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95846  13 58563 78407083 A  ERRORERROR'
2019-03-21 21:46:47 [DEBUG   ] Got command RPT from MCS: ref #95847
2019-03-21 21:46:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:46:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95847  77 58563 78407279 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:46:47 [DEBUG   ] Got command RPT from MCS: ref #95848
2019-03-21 21:46:47 [DEBUG   ] summary = ERROR
2019-03-21 21:46:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95848  13 58563 78407483 A  ERRORERROR'
2019-03-21 21:46:47 [DEBUG   ] Got command RPT from MCS: ref #95850
2019-03-21 21:46:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:46:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95850  77 58563 78407687 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:46:47 [DEBUG   ] Got command RPT from MCS: ref #95852
2019-03-21 21:46:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:46:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95852  12 58563 78407891 A  ERRORBœ™š'
2019-03-21 21:46:49 [DEBUG   ] Got command BAM from MCS: ref #95853
2019-03-21 21:46:49 [INFO    ] Finished processing BAM request
2019-03-21 21:46:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95853   8 58563 78409035 A  ERROR'
2019-03-21 21:46:49 [DEBUG   ] Got command BAM from MCS: ref #95854
2019-03-21 21:46:49 [INFO    ] Finished processing BAM request
2019-03-21 21:46:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95854   8 58563 78409043 A  ERROR'
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:46:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:46:49 [DEBUG   ] spawn_process: at 2019-03-21 21:46:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:47:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:47:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:47:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:47:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:47:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:47:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:47:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:47:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:47:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:47:30 [DEBUG   ] Finished updating board flags in 1.031 seconds
2019-03-21 21:47:38 [DEBUG   ] Got command BAM from MCS: ref #95859
2019-03-21 21:47:38 [INFO    ] Finished processing BAM request
2019-03-21 21:47:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95859   8 58563 78458035 A  ERROR'
2019-03-21 21:47:38 [DEBUG   ] Got command BAM from MCS: ref #95858
2019-03-21 21:47:38 [INFO    ] Finished processing BAM request
2019-03-21 21:47:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95858   8 58563 78458043 A  ERROR'
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:47:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:47:38 [DEBUG   ] spawn_process: at 2019-03-21 21:47:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:47:40 [DEBUG   ] Got command RPT from MCS: ref #95860
2019-03-21 21:47:40 [DEBUG   ] summary = ERROR
2019-03-21 21:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95860  13 58563 78460871 A  ERRORERROR'
2019-03-21 21:47:40 [DEBUG   ] Got command RPT from MCS: ref #95861
2019-03-21 21:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95861  77 58563 78460872 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:47:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:48:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 21:48:21 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 21:48:27 [DEBUG   ] Got command BAM from MCS: ref #95884
2019-03-21 21:48:27 [INFO    ] Finished processing BAM request
2019-03-21 21:48:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95884   8 58563 78507031 A  ERROR'
2019-03-21 21:48:27 [DEBUG   ] Got command BAM from MCS: ref #95883
2019-03-21 21:48:27 [INFO    ] Finished processing BAM request
2019-03-21 21:48:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95883   8 58563 78507035 A  ERROR'
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:48:27 [DEBUG   ] spawn_process: at 2019-03-21 21:48:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:48:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:48:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:48:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:48:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:48:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:48:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:48:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:48:31 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-03-21 21:48:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:49:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:49:16 [DEBUG   ] Got command BAM from MCS: ref #95885
2019-03-21 21:49:16 [INFO    ] Finished processing BAM request
2019-03-21 21:49:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95885   8 58563 78556035 A  ERROR'
2019-03-21 21:49:16 [DEBUG   ] Got command BAM from MCS: ref #95886
2019-03-21 21:49:16 [INFO    ] Finished processing BAM request
2019-03-21 21:49:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95886   8 58563 78556043 A  ERROR'
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:49:16 [DEBUG   ] spawn_process: at 2019-03-21 21:49:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:49:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 21:49:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:49:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:49:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:49:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:49:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:49:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:49:30 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-03-21 21:49:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 21:50:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 21:50:06 [DEBUG   ] Got command BAM from MCS: ref #95887
2019-03-21 21:50:06 [INFO    ] Finished processing BAM request
2019-03-21 21:50:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95887   8 58563 78606031 A  ERROR'
2019-03-21 21:50:06 [DEBUG   ] Got command BAM from MCS: ref #95888
2019-03-21 21:50:06 [INFO    ] Finished processing BAM request
2019-03-21 21:50:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95888   8 58563 78606035 A  ERROR'
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:50:06 [DEBUG   ] spawn_process: at 2019-03-21 21:50:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:50:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 21:50:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:50:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:50:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:50:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:50:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:50:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:50:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:50:30 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-03-21 21:50:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 21:50:56 [DEBUG   ] Got command BAM from MCS: ref #95895
2019-03-21 21:50:56 [INFO    ] Finished processing BAM request
2019-03-21 21:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95895   8 58563 78656035 A  ERROR'
2019-03-21 21:50:56 [DEBUG   ] Got command BAM from MCS: ref #95896
2019-03-21 21:50:56 [INFO    ] Finished processing BAM request
2019-03-21 21:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95896   8 58563 78656039 A  ERROR'
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:50:56 [DEBUG   ] spawn_process: at 2019-03-21 21:50:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:51:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 21:51:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:51:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:51:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:51:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:51:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:51:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:51:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:51:30 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-03-21 21:51:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:51:46 [DEBUG   ] Got command BAM from MCS: ref #95898
2019-03-21 21:51:46 [INFO    ] Finished processing BAM request
2019-03-21 21:51:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95898   8 58563 78706027 A  ERROR'
2019-03-21 21:51:46 [DEBUG   ] Got command BAM from MCS: ref #95897
2019-03-21 21:51:46 [INFO    ] Finished processing BAM request
2019-03-21 21:51:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95897   8 58563 78706031 A  ERROR'
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:51:46 [DEBUG   ] spawn_process: at 2019-03-21 21:51:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:51:47 [DEBUG   ] Got command RPT from MCS: ref #95899
2019-03-21 21:51:47 [DEBUG   ] summary = ERROR
2019-03-21 21:51:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95899  13 58563 78707175 A  ERRORERROR'
2019-03-21 21:51:47 [DEBUG   ] Got command RPT from MCS: ref #95900
2019-03-21 21:51:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:51:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95900  77 58563 78707367 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:51:47 [DEBUG   ] Got command RPT from MCS: ref #95901
2019-03-21 21:51:47 [DEBUG   ] summary = ERROR
2019-03-21 21:51:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95901  13 58563 78707571 A  ERRORERROR'
2019-03-21 21:51:47 [DEBUG   ] Got command RPT from MCS: ref #95902
2019-03-21 21:51:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:51:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95902  77 58563 78707775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:51:47 [DEBUG   ] Got command RPT from MCS: ref #95903
2019-03-21 21:51:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:51:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95903  12 58563 78707967 A  ERRORBœ™š'
2019-03-21 21:52:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:52:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:52:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:52:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 21:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:52:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:52:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:52:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:52:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:52:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:52:30 [DEBUG   ] Finished updating board flags in 1.037 seconds
2019-03-21 21:52:36 [DEBUG   ] Got command BAM from MCS: ref #95904
2019-03-21 21:52:36 [INFO    ] Finished processing BAM request
2019-03-21 21:52:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95904   8 58563 78756027 A  ERROR'
2019-03-21 21:52:36 [DEBUG   ] Got command BAM from MCS: ref #95905
2019-03-21 21:52:36 [INFO    ] Finished processing BAM request
2019-03-21 21:52:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95905   8 58563 78756031 A  ERROR'
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 21:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 21:52:36 [DEBUG   ] spawn_process: at 2019-03-21 21:52:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 21:52:40 [DEBUG   ] Got command RPT from MCS: ref #95906
2019-03-21 21:52:40 [DEBUG   ] summary = ERROR
2019-03-21 21:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95906  13 58563 78760867 A  ERRORERROR'
2019-03-21 21:52:40 [DEBUG   ] Got command RPT from MCS: ref #95907
2019-03-21 21:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95907  77 58563 78760867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:52:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:53:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:53:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:53:26 [DEBUG   ] Got command BAM from MCS: ref #95924
2019-03-21 21:53:26 [INFO    ] Finished processing BAM request
2019-03-21 21:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95924   8 58563 78806027 A  ERROR'
2019-03-21 21:53:26 [DEBUG   ] Got command BAM from MCS: ref #95923
2019-03-21 21:53:26 [INFO    ] Finished processing BAM request
2019-03-21 21:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95923   8 58563 78806031 A  ERROR'
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:53:26 [DEBUG   ] spawn_process: at 2019-03-21 21:53:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:53:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:53:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:53:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:53:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:53:30 [WARNING ] (13, 1, 'bot')
2019-03-21 21:53:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:53:30 [DEBUG   ] Finished updating board flags in 0.947 seconds
2019-03-21 21:53:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:54:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:54:17 [DEBUG   ] Got command BAM from MCS: ref #95932
2019-03-21 21:54:17 [INFO    ] Finished processing BAM request
2019-03-21 21:54:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95932   8 58563 78857035 A  ERROR'
2019-03-21 21:54:17 [DEBUG   ] Got command BAM from MCS: ref #95931
2019-03-21 21:54:17 [INFO    ] Finished processing BAM request
2019-03-21 21:54:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95931   8 58563 78857039 A  ERROR'
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:54:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:54:17 [DEBUG   ] spawn_process: at 2019-03-21 21:54:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:54:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:54:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:54:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:54:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:54:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:54:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:54:31 [DEBUG   ] Finished updating board flags in 1.372 seconds
2019-03-21 21:54:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:55:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:55:08 [DEBUG   ] Got command BAM from MCS: ref #95933
2019-03-21 21:55:08 [INFO    ] Finished processing BAM request
2019-03-21 21:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95933   8 58563 78908031 A  ERROR'
2019-03-21 21:55:08 [DEBUG   ] Got command BAM from MCS: ref #95934
2019-03-21 21:55:08 [INFO    ] Finished processing BAM request
2019-03-21 21:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95934   8 58563 78908035 A  ERROR'
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:55:08 [DEBUG   ] spawn_process: at 2019-03-21 21:55:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:55:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 21:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:55:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:55:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:55:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:55:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:55:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:55:31 [DEBUG   ] Finished updating board flags in 1.218 seconds
2019-03-21 21:55:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 21:55:59 [DEBUG   ] Got command BAM from MCS: ref #95935
2019-03-21 21:55:59 [INFO    ] Finished processing BAM request
2019-03-21 21:55:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:55:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95935   8 58563 78959031 A  ERROR'
2019-03-21 21:55:59 [DEBUG   ] Got command BAM from MCS: ref #95936
2019-03-21 21:55:59 [INFO    ] Finished processing BAM request
2019-03-21 21:55:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:55:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95936   8 58563 78959035 A  ERROR'
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 21:55:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 21:55:59 [DEBUG   ] spawn_process: at 2019-03-21 21:55:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 21:56:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:56:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:56:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:56:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:56:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:56:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:56:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:56:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:56:31 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-03-21 21:56:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:56:47 [DEBUG   ] Got command RPT from MCS: ref #95939
2019-03-21 21:56:47 [DEBUG   ] summary = ERROR
2019-03-21 21:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95939  13 58563 79007259 A  ERRORERROR'
2019-03-21 21:56:47 [DEBUG   ] Got command RPT from MCS: ref #95940
2019-03-21 21:56:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95940  77 58563 79007451 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:56:47 [DEBUG   ] Got command RPT from MCS: ref #95941
2019-03-21 21:56:47 [DEBUG   ] summary = ERROR
2019-03-21 21:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95941  13 58563 79007655 A  ERRORERROR'
2019-03-21 21:56:47 [DEBUG   ] Got command RPT from MCS: ref #95943
2019-03-21 21:56:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95943  77 58563 79007859 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:56:48 [DEBUG   ] Got command RPT from MCS: ref #95944
2019-03-21 21:56:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 21:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95944  12 58563 79008063 A  ERRORBš™š'
2019-03-21 21:56:50 [DEBUG   ] Got command BAM from MCS: ref #95949
2019-03-21 21:56:50 [INFO    ] Finished processing BAM request
2019-03-21 21:56:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95949   8 58563 79010035 A  ERROR'
2019-03-21 21:56:50 [DEBUG   ] Got command BAM from MCS: ref #95950
2019-03-21 21:56:50 [INFO    ] Finished processing BAM request
2019-03-21 21:56:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95950   8 58563 79010039 A  ERROR'
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 21:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 21:56:50 [DEBUG   ] spawn_process: at 2019-03-21 21:56:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 21:57:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:57:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:57:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 21:57:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:57:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:57:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:57:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:57:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:57:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:57:31 [DEBUG   ] Finished updating board flags in 1.059 seconds
2019-03-21 21:57:40 [DEBUG   ] Got command RPT from MCS: ref #95957
2019-03-21 21:57:40 [DEBUG   ] summary = ERROR
2019-03-21 21:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95957  13 58563 79060871 A  ERRORERROR'
2019-03-21 21:57:40 [DEBUG   ] Got command RPT from MCS: ref #95958
2019-03-21 21:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 21:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95958  77 58563 79060871 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 21:57:42 [DEBUG   ] Got command BAM from MCS: ref #95974
2019-03-21 21:57:42 [INFO    ] Finished processing BAM request
2019-03-21 21:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95974   8 58563 79062027 A  ERROR'
2019-03-21 21:57:42 [DEBUG   ] Got command BAM from MCS: ref #95975
2019-03-21 21:57:42 [INFO    ] Finished processing BAM request
2019-03-21 21:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95975   8 58563 79062031 A  ERROR'
2019-03-21 21:57:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 21:57:42 [DEBUG   ] spawn_process: at 2019-03-21 21:57:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 21:58:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:58:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:58:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 21:58:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:58:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 21:58:32 [WARNING ] (13, 1, 'bot')
2019-03-21 21:58:32 [WARNING ] (13, 1, 'bot')
2019-03-21 21:58:32 [WARNING ] (13, 1, 'bot')
2019-03-21 21:58:32 [WARNING ] (13, 1, 'bot')
2019-03-21 21:58:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:58:32 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-03-21 21:58:34 [DEBUG   ] Got command BAM from MCS: ref #95976
2019-03-21 21:58:34 [INFO    ] Finished processing BAM request
2019-03-21 21:58:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95976   8 58563 79114027 A  ERROR'
2019-03-21 21:58:34 [DEBUG   ] Got command BAM from MCS: ref #95977
2019-03-21 21:58:34 [INFO    ] Finished processing BAM request
2019-03-21 21:58:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95977   8 58563 79114031 A  ERROR'
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 21:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 21:58:34 [DEBUG   ] spawn_process: at 2019-03-21 21:58:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 21:58:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:59:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:59:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 21:59:26 [DEBUG   ] Got command BAM from MCS: ref #95978
2019-03-21 21:59:26 [INFO    ] Finished processing BAM request
2019-03-21 21:59:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:59:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95978   8 58563 79166035 A  ERROR'
2019-03-21 21:59:26 [DEBUG   ] Got command BAM from MCS: ref #95979
2019-03-21 21:59:26 [INFO    ] Finished processing BAM request
2019-03-21 21:59:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 21:59:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95979   8 58563 79166039 A  ERROR'
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 21:59:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 21:59:26 [DEBUG   ] spawn_process: at 2019-03-21 21:59:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 21:59:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 21:59:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 21:59:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:59:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:59:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:59:31 [WARNING ] (13, 1, 'bot')
2019-03-21 21:59:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 21:59:31 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-03-21 21:59:42 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2019-03-21 22:00:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:00:18 [DEBUG   ] Got command BAM from MCS: ref #95987
2019-03-21 22:00:18 [INFO    ] Finished processing BAM request
2019-03-21 22:00:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95987   8 58563 79218031 A  ERROR'
2019-03-21 22:00:18 [DEBUG   ] Got command BAM from MCS: ref #95986
2019-03-21 22:00:18 [INFO    ] Finished processing BAM request
2019-03-21 22:00:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95986   8 58563 79218035 A  ERROR'
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:00:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:00:18 [DEBUG   ] spawn_process: at 2019-03-21 22:00:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:00:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:00:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:00:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:00:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:00:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:00:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:00:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:00:31 [DEBUG   ] Finished updating board flags in 1.226 seconds
2019-03-21 22:00:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:01:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:01:10 [DEBUG   ] Got command BAM from MCS: ref #95988
2019-03-21 22:01:10 [INFO    ] Finished processing BAM request
2019-03-21 22:01:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95988   8 58563 79270035 A  ERROR'
2019-03-21 22:01:10 [DEBUG   ] Got command BAM from MCS: ref #95989
2019-03-21 22:01:10 [INFO    ] Finished processing BAM request
2019-03-21 22:01:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95989   8 58563 79270039 A  ERROR'
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:01:10 [DEBUG   ] spawn_process: at 2019-03-21 22:01:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:01:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-21 22:01:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:01:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:01:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:01:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:01:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:01:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:01:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:01:31 [DEBUG   ] Finished updating board flags in 1.215 seconds
2019-03-21 22:01:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:01:47 [DEBUG   ] Got command RPT from MCS: ref #95990
2019-03-21 22:01:47 [DEBUG   ] summary = ERROR
2019-03-21 22:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95990  13 58563 79307343 A  ERRORERROR'
2019-03-21 22:01:47 [DEBUG   ] Got command RPT from MCS: ref #95991
2019-03-21 22:01:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95991  77 58563 79307547 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:01:47 [DEBUG   ] Got command RPT from MCS: ref #95992
2019-03-21 22:01:47 [DEBUG   ] summary = ERROR
2019-03-21 22:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95992  13 58563 79307739 A  ERRORERROR'
2019-03-21 22:01:47 [DEBUG   ] Got command RPT from MCS: ref #95993
2019-03-21 22:01:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95993  77 58563 79307943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:01:48 [DEBUG   ] Got command RPT from MCS: ref #95994
2019-03-21 22:01:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95994  12 58563 79308147 A  ERRORBœ™š'
2019-03-21 22:02:03 [DEBUG   ] Got command BAM from MCS: ref #95996
2019-03-21 22:02:03 [INFO    ] Finished processing BAM request
2019-03-21 22:02:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:02:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95996   8 58563 79323031 A  ERROR'
2019-03-21 22:02:03 [DEBUG   ] Got command BAM from MCS: ref #95995
2019-03-21 22:02:03 [INFO    ] Finished processing BAM request
2019-03-21 22:02:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:02:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    95995   8 58563 79323035 A  ERROR'
2019-03-21 22:02:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:02:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:02:03 [DEBUG   ] spawn_process: at 2019-03-21 22:02:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:02:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 22:02:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:02:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:02:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:02:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:02:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:02:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:02:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:02:31 [DEBUG   ] Finished updating board flags in 1.160 seconds
2019-03-21 22:02:40 [DEBUG   ] Got command RPT from MCS: ref #95997
2019-03-21 22:02:40 [DEBUG   ] summary = ERROR
2019-03-21 22:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95997  13 58563 79360871 A  ERRORERROR'
2019-03-21 22:02:40 [DEBUG   ] Got command RPT from MCS: ref #95998
2019-03-21 22:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    95998  77 58563 79360871 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:02:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 22:02:56 [DEBUG   ] Got command BAM from MCS: ref #96020
2019-03-21 22:02:56 [INFO    ] Finished processing BAM request
2019-03-21 22:02:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:02:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96020   8 58563 79376031 A  ERROR'
2019-03-21 22:02:56 [DEBUG   ] Got command BAM from MCS: ref #96021
2019-03-21 22:02:56 [INFO    ] Finished processing BAM request
2019-03-21 22:02:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:02:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96021   8 58563 79376035 A  ERROR'
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 22:02:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 22:02:56 [DEBUG   ] spawn_process: at 2019-03-21 22:02:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 22:03:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 22:03:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:03:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:03:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:03:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:03:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:03:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:03:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:03:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:03:31 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-03-21 22:03:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:03:49 [DEBUG   ] Got command BAM from MCS: ref #96023
2019-03-21 22:03:49 [INFO    ] Finished processing BAM request
2019-03-21 22:03:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96023   8 58563 79429031 A  ERROR'
2019-03-21 22:03:49 [DEBUG   ] Got command BAM from MCS: ref #96022
2019-03-21 22:03:49 [INFO    ] Finished processing BAM request
2019-03-21 22:03:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96022   8 58563 79429035 A  ERROR'
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:03:49 [DEBUG   ] spawn_process: at 2019-03-21 22:03:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:04:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:04:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:04:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:04:31 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:04:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:04:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:04:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:04:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:04:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:04:31 [DEBUG   ] Finished updating board flags in 1.028 seconds
2019-03-21 22:04:42 [DEBUG   ] Got command BAM from MCS: ref #96025
2019-03-21 22:04:42 [INFO    ] Finished processing BAM request
2019-03-21 22:04:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:04:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96025   8 58563 79482031 A  ERROR'
2019-03-21 22:04:42 [DEBUG   ] Got command BAM from MCS: ref #96024
2019-03-21 22:04:42 [INFO    ] Finished processing BAM request
2019-03-21 22:04:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:04:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96024   8 58563 79482035 A  ERROR'
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:04:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:04:42 [DEBUG   ] spawn_process: at 2019-03-21 22:04:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:04:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:05:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 22:05:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:05:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:05:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:05:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:05:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:05:31 [WARNING ] (13, 1, 'bot')
2019-03-21 22:05:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:05:31 [DEBUG   ] Finished updating board flags in 0.968 seconds
2019-03-21 22:05:36 [DEBUG   ] Got command BAM from MCS: ref #96026
2019-03-21 22:05:36 [INFO    ] Finished processing BAM request
2019-03-21 22:05:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96026   8 58563 79536031 A  ERROR'
2019-03-21 22:05:36 [DEBUG   ] Got command BAM from MCS: ref #96027
2019-03-21 22:05:36 [INFO    ] Finished processing BAM request
2019-03-21 22:05:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96027   8 58563 79536035 A  ERROR'
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:05:36 [DEBUG   ] spawn_process: at 2019-03-21 22:05:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:05:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:06:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:06:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:06:30 [DEBUG   ] Got command BAM from MCS: ref #96035
2019-03-21 22:06:30 [INFO    ] Finished processing BAM request
2019-03-21 22:06:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96035   8 58563 79590035 A  ERROR'
2019-03-21 22:06:30 [DEBUG   ] Got command BAM from MCS: ref #96034
2019-03-21 22:06:30 [INFO    ] Finished processing BAM request
2019-03-21 22:06:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96034   8 58563 79590039 A  ERROR'
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:06:30 [DEBUG   ] spawn_process: at 2019-03-21 22:06:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:06:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:06:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:06:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:06:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:06:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:06:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:06:32 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-03-21 22:06:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:06:47 [DEBUG   ] Got command RPT from MCS: ref #96038
2019-03-21 22:06:47 [DEBUG   ] summary = ERROR
2019-03-21 22:06:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96038  13 58563 79607423 A  ERRORERROR'
2019-03-21 22:06:47 [DEBUG   ] Got command RPT from MCS: ref #96039
2019-03-21 22:06:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:06:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96039  77 58563 79607627 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:06:47 [DEBUG   ] Got command RPT from MCS: ref #96040
2019-03-21 22:06:47 [DEBUG   ] summary = ERROR
2019-03-21 22:06:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96040  13 58563 79607831 A  ERRORERROR'
2019-03-21 22:06:48 [DEBUG   ] Got command RPT from MCS: ref #96042
2019-03-21 22:06:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96042  77 58563 79608023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:06:48 [DEBUG   ] Got command RPT from MCS: ref #96043
2019-03-21 22:06:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96043  12 58563 79608227 A  ERRORB›™š'
2019-03-21 22:07:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:07:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:07:24 [DEBUG   ] Got command BAM from MCS: ref #96049
2019-03-21 22:07:24 [INFO    ] Finished processing BAM request
2019-03-21 22:07:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96049   8 58563 79644031 A  ERROR'
2019-03-21 22:07:24 [DEBUG   ] Got command BAM from MCS: ref #96048
2019-03-21 22:07:24 [INFO    ] Finished processing BAM request
2019-03-21 22:07:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96048   8 58563 79644035 A  ERROR'
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:07:24 [DEBUG   ] spawn_process: at 2019-03-21 22:07:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:07:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 22:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:07:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:07:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:07:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:07:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:07:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:07:32 [DEBUG   ] Finished updating board flags in 1.229 seconds
2019-03-21 22:07:40 [DEBUG   ] Got command RPT from MCS: ref #96050
2019-03-21 22:07:40 [DEBUG   ] summary = ERROR
2019-03-21 22:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96050  13 58563 79660871 A  ERRORERROR'
2019-03-21 22:07:40 [DEBUG   ] Got command RPT from MCS: ref #96051
2019-03-21 22:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96051  77 58563 79660871 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:07:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 22:08:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:08:18 [DEBUG   ] Got command BAM from MCS: ref #96067
2019-03-21 22:08:18 [INFO    ] Finished processing BAM request
2019-03-21 22:08:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96067   8 58563 79698031 A  ERROR'
2019-03-21 22:08:18 [DEBUG   ] Got command BAM from MCS: ref #96068
2019-03-21 22:08:18 [INFO    ] Finished processing BAM request
2019-03-21 22:08:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96068   8 58563 79698035 A  ERROR'
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:08:18 [DEBUG   ] spawn_process: at 2019-03-21 22:08:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:08:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:08:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:08:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:08:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:08:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:08:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:08:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:08:32 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-03-21 22:08:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:09:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:09:12 [DEBUG   ] Got command BAM from MCS: ref #96076
2019-03-21 22:09:12 [INFO    ] Finished processing BAM request
2019-03-21 22:09:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96076   8 58563 79752031 A  ERROR'
2019-03-21 22:09:12 [DEBUG   ] Got command BAM from MCS: ref #96075
2019-03-21 22:09:12 [INFO    ] Finished processing BAM request
2019-03-21 22:09:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96075   8 58563 79752035 A  ERROR'
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:09:12 [DEBUG   ] spawn_process: at 2019-03-21 22:09:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:09:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:09:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:09:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 22:09:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:09:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:09:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:09:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:09:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:09:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:09:32 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-03-21 22:09:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:10:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:10:07 [DEBUG   ] Got command BAM from MCS: ref #96077
2019-03-21 22:10:07 [INFO    ] Finished processing BAM request
2019-03-21 22:10:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96077   8 58563 79807027 A  ERROR'
2019-03-21 22:10:07 [DEBUG   ] Got command BAM from MCS: ref #96078
2019-03-21 22:10:07 [INFO    ] Finished processing BAM request
2019-03-21 22:10:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96078   8 58563 79807031 A  ERROR'
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:10:07 [DEBUG   ] spawn_process: at 2019-03-21 22:10:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:10:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:10:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:10:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:10:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:10:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:10:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:10:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:10:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:10:33 [DEBUG   ] Finished updating board flags in 2.002 seconds
2019-03-21 22:10:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:11:02 [DEBUG   ] Got command BAM from MCS: ref #96080
2019-03-21 22:11:02 [INFO    ] Finished processing BAM request
2019-03-21 22:11:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96080   8 58563 79862027 A  ERROR'
2019-03-21 22:11:02 [DEBUG   ] Got command BAM from MCS: ref #96079
2019-03-21 22:11:02 [INFO    ] Finished processing BAM request
2019-03-21 22:11:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96079   8 58563 79862031 A  ERROR'
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:11:02 [DEBUG   ] spawn_process: at 2019-03-21 22:11:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:11:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:11:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:11:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:11:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:11:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:11:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:11:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:11:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:11:33 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-03-21 22:11:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:11:47 [DEBUG   ] Got command RPT from MCS: ref #96081
2019-03-21 22:11:47 [DEBUG   ] summary = ERROR
2019-03-21 22:11:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96081  13 58563 79907515 A  ERRORERROR'
2019-03-21 22:11:47 [DEBUG   ] Got command RPT from MCS: ref #96082
2019-03-21 22:11:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:11:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96082  77 58563 79907719 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:11:47 [DEBUG   ] Got command RPT from MCS: ref #96083
2019-03-21 22:11:47 [DEBUG   ] summary = ERROR
2019-03-21 22:11:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96083  13 58563 79907911 A  ERRORERROR'
2019-03-21 22:11:48 [DEBUG   ] Got command RPT from MCS: ref #96084
2019-03-21 22:11:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96084  77 58563 79908115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:11:48 [DEBUG   ] Got command RPT from MCS: ref #96085
2019-03-21 22:11:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96085  12 58563 79908319 A  ERRORB›™š'
2019-03-21 22:11:57 [DEBUG   ] Got command BAM from MCS: ref #96092
2019-03-21 22:11:57 [INFO    ] Finished processing BAM request
2019-03-21 22:11:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96092   8 58563 79917035 A  ERROR'
2019-03-21 22:11:57 [DEBUG   ] Got command BAM from MCS: ref #96093
2019-03-21 22:11:57 [INFO    ] Finished processing BAM request
2019-03-21 22:11:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96093   8 58563 79917039 A  ERROR'
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 22:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 22:11:57 [DEBUG   ] spawn_process: at 2019-03-21 22:11:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 22:12:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:12:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:12:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:12:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:12:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:12:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:12:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:12:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:12:33 [DEBUG   ] Finished updating board flags in 2.227 seconds
2019-03-21 22:12:40 [DEBUG   ] Got command RPT from MCS: ref #96094
2019-03-21 22:12:40 [DEBUG   ] summary = ERROR
2019-03-21 22:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96094  13 58563 79960879 A  ERRORERROR'
2019-03-21 22:12:40 [DEBUG   ] Got command RPT from MCS: ref #96095
2019-03-21 22:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96095  77 58563 79960879 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:12:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:12:52 [DEBUG   ] Got command BAM from MCS: ref #96111
2019-03-21 22:12:52 [INFO    ] Finished processing BAM request
2019-03-21 22:12:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:12:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96111   8 58563 79972031 A  ERROR'
2019-03-21 22:12:52 [DEBUG   ] Got command BAM from MCS: ref #96112
2019-03-21 22:12:52 [INFO    ] Finished processing BAM request
2019-03-21 22:12:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:12:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96112   8 58563 79972035 A  ERROR'
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:12:52 [DEBUG   ] spawn_process: at 2019-03-21 22:12:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:13:03 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 22:13:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 22:13:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:13:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:13:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:13:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:13:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:13:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:13:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:13:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:13:32 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-03-21 22:13:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 22:13:48 [DEBUG   ] Got command BAM from MCS: ref #96113
2019-03-21 22:13:48 [INFO    ] Finished processing BAM request
2019-03-21 22:13:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:13:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96113   8 58563 80028035 A  ERROR'
2019-03-21 22:13:48 [DEBUG   ] Got command BAM from MCS: ref #96114
2019-03-21 22:13:48 [INFO    ] Finished processing BAM request
2019-03-21 22:13:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:13:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96114   8 58563 80028039 A  ERROR'
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 22:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 22:13:48 [DEBUG   ] spawn_process: at 2019-03-21 22:13:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 22:14:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 22:14:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:14:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:14:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:14:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:14:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:14:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:14:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:14:32 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-03-21 22:14:44 [DEBUG   ] Got command BAM from MCS: ref #96116
2019-03-21 22:14:44 [INFO    ] Finished processing BAM request
2019-03-21 22:14:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96116   8 58563 80084027 A  ERROR'
2019-03-21 22:14:44 [DEBUG   ] Got command BAM from MCS: ref #96115
2019-03-21 22:14:44 [INFO    ] Finished processing BAM request
2019-03-21 22:14:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96115   8 58563 80084031 A  ERROR'
2019-03-21 22:14:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:14:44 [DEBUG   ] spawn_process: at 2019-03-21 22:14:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:15:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:15:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:15:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:15:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:15:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:15:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:15:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:15:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:15:32 [DEBUG   ] Finished updating board flags in 1.231 seconds
2019-03-21 22:15:40 [DEBUG   ] Got command BAM from MCS: ref #96123
2019-03-21 22:15:40 [INFO    ] Finished processing BAM request
2019-03-21 22:15:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96123   8 58563 80140027 A  ERROR'
2019-03-21 22:15:40 [DEBUG   ] Got command BAM from MCS: ref #96124
2019-03-21 22:15:40 [INFO    ] Finished processing BAM request
2019-03-21 22:15:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96124   8 58563 80140031 A  ERROR'
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:15:40 [DEBUG   ] spawn_process: at 2019-03-21 22:15:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:15:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:16:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:16:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:16:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:16:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:16:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:16:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:16:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:16:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:16:32 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-03-21 22:16:36 [DEBUG   ] Got command BAM from MCS: ref #96125
2019-03-21 22:16:36 [INFO    ] Finished processing BAM request
2019-03-21 22:16:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96125   8 58563 80196031 A  ERROR'
2019-03-21 22:16:36 [DEBUG   ] Got command BAM from MCS: ref #96126
2019-03-21 22:16:36 [INFO    ] Finished processing BAM request
2019-03-21 22:16:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96126   8 58563 80196035 A  ERROR'
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:16:36 [DEBUG   ] spawn_process: at 2019-03-21 22:16:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:16:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:16:47 [DEBUG   ] Got command RPT from MCS: ref #96129
2019-03-21 22:16:47 [DEBUG   ] summary = ERROR
2019-03-21 22:16:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96129  13 58563 80207603 A  ERRORERROR'
2019-03-21 22:16:47 [DEBUG   ] Got command RPT from MCS: ref #96130
2019-03-21 22:16:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:16:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96130  77 58563 80207795 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:16:47 [DEBUG   ] Got command RPT from MCS: ref #96131
2019-03-21 22:16:47 [DEBUG   ] summary = ERROR
2019-03-21 22:16:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96131  13 58563 80207999 A  ERRORERROR'
2019-03-21 22:16:48 [DEBUG   ] Got command RPT from MCS: ref #96133
2019-03-21 22:16:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96133  77 58563 80208203 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:16:48 [DEBUG   ] Got command RPT from MCS: ref #96134
2019-03-21 22:16:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96134  12 58563 80208399 A  ERRORBœ™š'
2019-03-21 22:17:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:17:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:17:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:17:33 [DEBUG   ] Got command BAM from MCS: ref #96140
2019-03-21 22:17:33 [INFO    ] Finished processing BAM request
2019-03-21 22:17:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96140   8 58563 80253031 A  ERROR'
2019-03-21 22:17:33 [DEBUG   ] Got command BAM from MCS: ref #96139
2019-03-21 22:17:33 [INFO    ] Finished processing BAM request
2019-03-21 22:17:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96139   8 58563 80253035 A  ERROR'
2019-03-21 22:17:33 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:17:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:17:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:17:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:17:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:17:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:17:33 [DEBUG   ] Finished updating board flags in 1.746 seconds
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:17:33 [DEBUG   ] spawn_process: at 2019-03-21 22:17:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:17:40 [DEBUG   ] Got command RPT from MCS: ref #96141
2019-03-21 22:17:40 [DEBUG   ] summary = ERROR
2019-03-21 22:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96141  13 58563 80260883 A  ERRORERROR'
2019-03-21 22:17:40 [DEBUG   ] Got command RPT from MCS: ref #96142
2019-03-21 22:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96142  77 58563 80260883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:17:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:18:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:18:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:18:30 [DEBUG   ] Got command BAM from MCS: ref #96164
2019-03-21 22:18:30 [INFO    ] Finished processing BAM request
2019-03-21 22:18:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96164   8 58563 80310031 A  ERROR'
2019-03-21 22:18:30 [DEBUG   ] Got command BAM from MCS: ref #96165
2019-03-21 22:18:30 [INFO    ] Finished processing BAM request
2019-03-21 22:18:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96165   8 58563 80310035 A  ERROR'
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:18:30 [DEBUG   ] spawn_process: at 2019-03-21 22:18:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:18:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:18:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:18:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:18:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:18:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:18:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:18:32 [WARNING ] (13, 1, 'bot')
2019-03-21 22:18:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:18:32 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-03-21 22:18:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:19:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:19:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:19:27 [DEBUG   ] Got command BAM from MCS: ref #96166
2019-03-21 22:19:27 [INFO    ] Finished processing BAM request
2019-03-21 22:19:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96166   8 58563 80367027 A  ERROR'
2019-03-21 22:19:27 [DEBUG   ] Got command BAM from MCS: ref #96167
2019-03-21 22:19:27 [INFO    ] Finished processing BAM request
2019-03-21 22:19:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96167   8 58563 80367031 A  ERROR'
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:19:27 [DEBUG   ] spawn_process: at 2019-03-21 22:19:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:19:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:19:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:19:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:19:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:19:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:19:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:19:33 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-03-21 22:19:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:20:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:20:24 [DEBUG   ] Got command BAM from MCS: ref #96168
2019-03-21 22:20:24 [INFO    ] Finished processing BAM request
2019-03-21 22:20:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:20:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96168   8 58563 80424027 A  ERROR'
2019-03-21 22:20:24 [DEBUG   ] Got command BAM from MCS: ref #96169
2019-03-21 22:20:24 [INFO    ] Finished processing BAM request
2019-03-21 22:20:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:20:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96169   8 58563 80424031 A  ERROR'
2019-03-21 22:20:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 22:20:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 22:20:24 [DEBUG   ] spawn_process: at 2019-03-21 22:20:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 22:20:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:20:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:20:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:20:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:20:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:20:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:20:33 [DEBUG   ] Finished updating board flags in 1.215 seconds
2019-03-21 22:20:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 22:21:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-03-21 22:21:22 [DEBUG   ] Got command BAM from MCS: ref #96177
2019-03-21 22:21:22 [INFO    ] Finished processing BAM request
2019-03-21 22:21:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96177   8 58563 80482031 A  ERROR'
2019-03-21 22:21:22 [DEBUG   ] Got command BAM from MCS: ref #96176
2019-03-21 22:21:22 [INFO    ] Finished processing BAM request
2019-03-21 22:21:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96176   8 58563 80482035 A  ERROR'
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:21:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:21:22 [DEBUG   ] spawn_process: at 2019-03-21 22:21:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:21:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:21:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:21:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:21:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:21:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:21:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:21:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:21:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:21:33 [DEBUG   ] Finished updating board flags in 1.175 seconds
2019-03-21 22:21:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:21:47 [DEBUG   ] Got command RPT from MCS: ref #96178
2019-03-21 22:21:47 [DEBUG   ] summary = ERROR
2019-03-21 22:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96178  13 58563 80507691 A  ERRORERROR'
2019-03-21 22:21:47 [DEBUG   ] Got command RPT from MCS: ref #96179
2019-03-21 22:21:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96179  77 58563 80507883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:21:48 [DEBUG   ] Got command RPT from MCS: ref #96180
2019-03-21 22:21:48 [DEBUG   ] summary = ERROR
2019-03-21 22:21:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96180  13 58563 80508087 A  ERRORERROR'
2019-03-21 22:21:48 [DEBUG   ] Got command RPT from MCS: ref #96181
2019-03-21 22:21:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:21:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96181  77 58563 80508291 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:21:48 [DEBUG   ] Got command RPT from MCS: ref #96182
2019-03-21 22:21:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:21:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96182  12 58563 80508495 A  ERRORB›™š'
2019-03-21 22:22:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:22:20 [DEBUG   ] Got command BAM from MCS: ref #96184
2019-03-21 22:22:20 [INFO    ] Finished processing BAM request
2019-03-21 22:22:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96184   8 58563 80540027 A  ERROR'
2019-03-21 22:22:20 [DEBUG   ] Got command BAM from MCS: ref #96183
2019-03-21 22:22:20 [INFO    ] Finished processing BAM request
2019-03-21 22:22:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96183   8 58563 80540031 A  ERROR'
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 22:22:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 22:22:20 [DEBUG   ] spawn_process: at 2019-03-21 22:22:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 22:22:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:22:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:22:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:22:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:22:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:22:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:22:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:22:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:22:33 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-03-21 22:22:40 [DEBUG   ] Got command RPT from MCS: ref #96185
2019-03-21 22:22:40 [DEBUG   ] summary = ERROR
2019-03-21 22:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96185  13 58563 80560875 A  ERRORERROR'
2019-03-21 22:22:40 [DEBUG   ] Got command RPT from MCS: ref #96186
2019-03-21 22:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96186  77 58563 80560875 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:22:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:23:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 22:23:18 [DEBUG   ] Got command BAM from MCS: ref #96202
2019-03-21 22:23:18 [INFO    ] Finished processing BAM request
2019-03-21 22:23:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96202   8 58563 80598027 A  ERROR'
2019-03-21 22:23:18 [DEBUG   ] Got command BAM from MCS: ref #96203
2019-03-21 22:23:18 [INFO    ] Finished processing BAM request
2019-03-21 22:23:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96203   8 58563 80598031 A  ERROR'
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:23:18 [DEBUG   ] spawn_process: at 2019-03-21 22:23:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:23:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:23:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:23:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:23:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:23:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:23:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:23:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:23:34 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-03-21 22:23:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:24:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:24:16 [DEBUG   ] Got command BAM from MCS: ref #96210
2019-03-21 22:24:16 [INFO    ] Finished processing BAM request
2019-03-21 22:24:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96210   8 58563 80656027 A  ERROR'
2019-03-21 22:24:16 [DEBUG   ] Got command BAM from MCS: ref #96211
2019-03-21 22:24:16 [INFO    ] Finished processing BAM request
2019-03-21 22:24:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96211   8 58563 80656031 A  ERROR'
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:24:16 [DEBUG   ] spawn_process: at 2019-03-21 22:24:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:24:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:24:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 22:24:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:24:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:24:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:24:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:24:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:24:33 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-03-21 22:24:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:25:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:25:15 [DEBUG   ] Got command BAM from MCS: ref #96212
2019-03-21 22:25:15 [INFO    ] Finished processing BAM request
2019-03-21 22:25:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96212   8 58563 80715031 A  ERROR'
2019-03-21 22:25:15 [DEBUG   ] Got command BAM from MCS: ref #96213
2019-03-21 22:25:15 [INFO    ] Finished processing BAM request
2019-03-21 22:25:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96213   8 58563 80715035 A  ERROR'
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:25:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:25:15 [DEBUG   ] spawn_process: at 2019-03-21 22:25:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:25:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:25:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:25:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:25:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:25:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:25:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:25:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:25:33 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-03-21 22:25:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:26:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:26:14 [DEBUG   ] Got command BAM from MCS: ref #96214
2019-03-21 22:26:14 [INFO    ] Finished processing BAM request
2019-03-21 22:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96214   8 58563 80774035 A  ERROR'
2019-03-21 22:26:14 [DEBUG   ] Got command BAM from MCS: ref #96215
2019-03-21 22:26:14 [INFO    ] Finished processing BAM request
2019-03-21 22:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96215   8 58563 80774039 A  ERROR'
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:26:14 [DEBUG   ] spawn_process: at 2019-03-21 22:26:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:26:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:26:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:26:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:26:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:26:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:26:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:26:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:26:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:26:33 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-03-21 22:26:44 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 22:26:47 [DEBUG   ] Got command RPT from MCS: ref #96218
2019-03-21 22:26:47 [DEBUG   ] summary = ERROR
2019-03-21 22:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96218  13 58563 80807775 A  ERRORERROR'
2019-03-21 22:26:47 [DEBUG   ] Got command RPT from MCS: ref #96219
2019-03-21 22:26:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96219  77 58563 80807967 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:26:48 [DEBUG   ] Got command RPT from MCS: ref #96220
2019-03-21 22:26:48 [DEBUG   ] summary = ERROR
2019-03-21 22:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96220  13 58563 80808171 A  ERRORERROR'
2019-03-21 22:26:48 [DEBUG   ] Got command RPT from MCS: ref #96222
2019-03-21 22:26:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96222  77 58563 80808375 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:26:48 [DEBUG   ] Got command RPT from MCS: ref #96224
2019-03-21 22:26:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96224  12 58563 80808579 A  ERRORB›™š'
2019-03-21 22:27:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:27:13 [DEBUG   ] Got command BAM from MCS: ref #96234
2019-03-21 22:27:13 [INFO    ] Finished processing BAM request
2019-03-21 22:27:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96234   8 58563 80833031 A  ERROR'
2019-03-21 22:27:13 [DEBUG   ] Got command BAM from MCS: ref #96235
2019-03-21 22:27:13 [INFO    ] Finished processing BAM request
2019-03-21 22:27:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:27:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96235   8 58563 80833035 A  ERROR'
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:27:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:27:13 [DEBUG   ] spawn_process: at 2019-03-21 22:27:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:27:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:27:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:27:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:27:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:27:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:27:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:27:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:27:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:27:33 [DEBUG   ] Finished updating board flags in 1.322 seconds
2019-03-21 22:27:40 [DEBUG   ] Got command RPT from MCS: ref #96236
2019-03-21 22:27:40 [DEBUG   ] summary = ERROR
2019-03-21 22:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96236  13 58563 80860879 A  ERRORERROR'
2019-03-21 22:27:40 [DEBUG   ] Got command RPT from MCS: ref #96237
2019-03-21 22:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96237  77 58563 80860879 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:27:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:28:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 22:28:12 [DEBUG   ] Got command BAM from MCS: ref #96254
2019-03-21 22:28:12 [INFO    ] Finished processing BAM request
2019-03-21 22:28:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96254   8 58563 80892027 A  ERROR'
2019-03-21 22:28:12 [DEBUG   ] Got command BAM from MCS: ref #96253
2019-03-21 22:28:12 [INFO    ] Finished processing BAM request
2019-03-21 22:28:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96253   8 58563 80892031 A  ERROR'
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:28:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:28:12 [DEBUG   ] spawn_process: at 2019-03-21 22:28:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:28:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 22:28:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:28:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:28:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:28:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:28:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:28:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:28:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:28:33 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-03-21 22:28:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 22:29:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:29:12 [DEBUG   ] Got command BAM from MCS: ref #96256
2019-03-21 22:29:12 [INFO    ] Finished processing BAM request
2019-03-21 22:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96256   8 58563 80952035 A  ERROR'
2019-03-21 22:29:12 [DEBUG   ] Got command BAM from MCS: ref #96255
2019-03-21 22:29:12 [INFO    ] Finished processing BAM request
2019-03-21 22:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96255   8 58563 80952039 A  ERROR'
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:29:12 [DEBUG   ] spawn_process: at 2019-03-21 22:29:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:29:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:29:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:29:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:29:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:29:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:29:33 [WARNING ] (13, 1, 'bot')
2019-03-21 22:29:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:29:33 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-03-21 22:29:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:30:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:30:12 [DEBUG   ] Got command BAM from MCS: ref #96264
2019-03-21 22:30:12 [INFO    ] Finished processing BAM request
2019-03-21 22:30:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96264   8 58563 81012031 A  ERROR'
2019-03-21 22:30:12 [DEBUG   ] Got command BAM from MCS: ref #96263
2019-03-21 22:30:12 [INFO    ] Finished processing BAM request
2019-03-21 22:30:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96263   8 58563 81012035 A  ERROR'
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:30:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:30:12 [DEBUG   ] spawn_process: at 2019-03-21 22:30:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:30:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:30:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:30:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:30:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:30:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:30:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:30:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:30:34 [DEBUG   ] Finished updating board flags in 1.761 seconds
2019-03-21 22:30:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 22:31:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:31:12 [DEBUG   ] Got command BAM from MCS: ref #96265
2019-03-21 22:31:12 [INFO    ] Finished processing BAM request
2019-03-21 22:31:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96265   8 58563 81072031 A  ERROR'
2019-03-21 22:31:12 [DEBUG   ] Got command BAM from MCS: ref #96266
2019-03-21 22:31:12 [INFO    ] Finished processing BAM request
2019-03-21 22:31:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96266   8 58563 81072035 A  ERROR'
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:31:12 [DEBUG   ] spawn_process: at 2019-03-21 22:31:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:31:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:31:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:31:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:31:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:31:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:31:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:31:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:31:34 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-03-21 22:31:45 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-03-21 22:31:47 [DEBUG   ] Got command RPT from MCS: ref #96267
2019-03-21 22:31:47 [DEBUG   ] summary = ERROR
2019-03-21 22:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96267  13 58563 81107867 A  ERRORERROR'
2019-03-21 22:31:48 [DEBUG   ] Got command RPT from MCS: ref #96268
2019-03-21 22:31:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96268  77 58563 81108059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:31:48 [DEBUG   ] Got command RPT from MCS: ref #96269
2019-03-21 22:31:48 [DEBUG   ] summary = ERROR
2019-03-21 22:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96269  13 58563 81108267 A  ERRORERROR'
2019-03-21 22:31:48 [DEBUG   ] Got command RPT from MCS: ref #96270
2019-03-21 22:31:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96270  77 58563 81108459 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:31:48 [DEBUG   ] Got command RPT from MCS: ref #96271
2019-03-21 22:31:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96271  12 58563 81108663 A  ERRORB›™š'
2019-03-21 22:32:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 22:32:12 [DEBUG   ] Got command BAM from MCS: ref #96273
2019-03-21 22:32:12 [INFO    ] Finished processing BAM request
2019-03-21 22:32:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96273   8 58563 81132027 A  ERROR'
2019-03-21 22:32:12 [DEBUG   ] Got command BAM from MCS: ref #96272
2019-03-21 22:32:12 [INFO    ] Finished processing BAM request
2019-03-21 22:32:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96272   8 58563 81132031 A  ERROR'
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:32:12 [DEBUG   ] spawn_process: at 2019-03-21 22:32:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:32:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 22:32:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:32:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:32:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:32:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:32:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:32:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:32:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:32:34 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-03-21 22:32:40 [DEBUG   ] Got command RPT from MCS: ref #96274
2019-03-21 22:32:40 [DEBUG   ] summary = ERROR
2019-03-21 22:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96274  13 58563 81160879 A  ERRORERROR'
2019-03-21 22:32:40 [DEBUG   ] Got command RPT from MCS: ref #96275
2019-03-21 22:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96275  77 58563 81160879 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:32:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 22:33:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 22:33:13 [DEBUG   ] Got command BAM from MCS: ref #96297
2019-03-21 22:33:13 [INFO    ] Finished processing BAM request
2019-03-21 22:33:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:33:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96297   8 58563 81193031 A  ERROR'
2019-03-21 22:33:13 [DEBUG   ] Got command BAM from MCS: ref #96298
2019-03-21 22:33:13 [INFO    ] Finished processing BAM request
2019-03-21 22:33:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:33:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96298   8 58563 81193035 A  ERROR'
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:33:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:33:13 [DEBUG   ] spawn_process: at 2019-03-21 22:33:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:33:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:33:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:33:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:33:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:33:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:33:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:33:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:33:34 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-03-21 22:33:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:34:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:34:14 [DEBUG   ] Got command BAM from MCS: ref #96299
2019-03-21 22:34:14 [INFO    ] Finished processing BAM request
2019-03-21 22:34:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96299   8 58563 81254035 A  ERROR'
2019-03-21 22:34:14 [DEBUG   ] Got command BAM from MCS: ref #96300
2019-03-21 22:34:14 [INFO    ] Finished processing BAM request
2019-03-21 22:34:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:34:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96300   8 58563 81254039 A  ERROR'
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:34:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:34:14 [DEBUG   ] spawn_process: at 2019-03-21 22:34:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:34:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:34:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:34:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:34:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:34:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:34:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:34:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:34:34 [DEBUG   ] Finished updating board flags in 1.069 seconds
2019-03-21 22:34:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:35:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:35:15 [DEBUG   ] Got command BAM from MCS: ref #96302
2019-03-21 22:35:15 [INFO    ] Finished processing BAM request
2019-03-21 22:35:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96302   8 58563 81315035 A  ERROR'
2019-03-21 22:35:15 [DEBUG   ] Got command BAM from MCS: ref #96301
2019-03-21 22:35:15 [INFO    ] Finished processing BAM request
2019-03-21 22:35:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96301   8 58563 81315043 A  ERROR'
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:35:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:35:15 [DEBUG   ] spawn_process: at 2019-03-21 22:35:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:35:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:35:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:35:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 22:35:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:35:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:35:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:35:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:35:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:35:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:35:35 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-03-21 22:35:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:36:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:36:16 [DEBUG   ] Got command BAM from MCS: ref #96310
2019-03-21 22:36:16 [INFO    ] Finished processing BAM request
2019-03-21 22:36:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96310   8 58563 81376031 A  ERROR'
2019-03-21 22:36:16 [DEBUG   ] Got command BAM from MCS: ref #96309
2019-03-21 22:36:16 [INFO    ] Finished processing BAM request
2019-03-21 22:36:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:36:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96309   8 58563 81376035 A  ERROR'
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 22:36:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 22:36:16 [DEBUG   ] spawn_process: at 2019-03-21 22:36:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 22:36:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:36:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:36:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:36:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:36:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:36:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:36:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:36:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:36:34 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-03-21 22:36:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:36:47 [DEBUG   ] Got command RPT from MCS: ref #96313
2019-03-21 22:36:47 [DEBUG   ] summary = ERROR
2019-03-21 22:36:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96313  13 58563 81407947 A  ERRORERROR'
2019-03-21 22:36:48 [DEBUG   ] Got command RPT from MCS: ref #96314
2019-03-21 22:36:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96314  77 58563 81408139 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:36:48 [DEBUG   ] Got command RPT from MCS: ref #96315
2019-03-21 22:36:48 [DEBUG   ] summary = ERROR
2019-03-21 22:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96315  13 58563 81408343 A  ERRORERROR'
2019-03-21 22:36:48 [DEBUG   ] Got command RPT from MCS: ref #96316
2019-03-21 22:36:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96316  77 58563 81408547 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:36:48 [DEBUG   ] Got command RPT from MCS: ref #96318
2019-03-21 22:36:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96318  12 58563 81408751 A  ERRORBœ™š'
2019-03-21 22:37:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:37:18 [DEBUG   ] Got command BAM from MCS: ref #96323
2019-03-21 22:37:18 [INFO    ] Finished processing BAM request
2019-03-21 22:37:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96323   8 58563 81438035 A  ERROR'
2019-03-21 22:37:18 [DEBUG   ] Got command BAM from MCS: ref #96324
2019-03-21 22:37:18 [INFO    ] Finished processing BAM request
2019-03-21 22:37:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96324   8 58563 81438039 A  ERROR'
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:37:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:37:18 [DEBUG   ] spawn_process: at 2019-03-21 22:37:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:37:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:37:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:37:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:37:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:37:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:37:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:37:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:37:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:37:34 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-03-21 22:37:40 [DEBUG   ] Got command RPT from MCS: ref #96325
2019-03-21 22:37:40 [DEBUG   ] summary = ERROR
2019-03-21 22:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96325  13 58563 81460887 A  ERRORERROR'
2019-03-21 22:37:40 [DEBUG   ] Got command RPT from MCS: ref #96326
2019-03-21 22:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96326  77 58563 81460887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:37:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:38:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:38:20 [DEBUG   ] Got command BAM from MCS: ref #96343
2019-03-21 22:38:20 [INFO    ] Finished processing BAM request
2019-03-21 22:38:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96343   8 58563 81500035 A  ERROR'
2019-03-21 22:38:20 [DEBUG   ] Got command BAM from MCS: ref #96342
2019-03-21 22:38:20 [INFO    ] Finished processing BAM request
2019-03-21 22:38:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96342   8 58563 81500039 A  ERROR'
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:38:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:38:20 [DEBUG   ] spawn_process: at 2019-03-21 22:38:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:38:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:38:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:38:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:38:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:38:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:38:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:38:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:38:34 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-03-21 22:38:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:39:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:39:22 [DEBUG   ] Got command BAM from MCS: ref #96351
2019-03-21 22:39:22 [INFO    ] Finished processing BAM request
2019-03-21 22:39:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96351   8 58563 81562031 A  ERROR'
2019-03-21 22:39:22 [DEBUG   ] Got command BAM from MCS: ref #96350
2019-03-21 22:39:22 [INFO    ] Finished processing BAM request
2019-03-21 22:39:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96350   8 58563 81562039 A  ERROR'
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 22:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 22:39:22 [DEBUG   ] spawn_process: at 2019-03-21 22:39:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 22:39:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:39:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:39:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:39:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:39:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:39:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:39:34 [WARNING ] (13, 1, 'bot')
2019-03-21 22:39:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:39:34 [DEBUG   ] Finished updating board flags in 0.976 seconds
2019-03-21 22:39:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 22:40:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:40:24 [DEBUG   ] Got command BAM from MCS: ref #96353
2019-03-21 22:40:24 [INFO    ] Finished processing BAM request
2019-03-21 22:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96353   8 58563 81624031 A  ERROR'
2019-03-21 22:40:24 [DEBUG   ] Got command BAM from MCS: ref #96352
2019-03-21 22:40:24 [INFO    ] Finished processing BAM request
2019-03-21 22:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96352   8 58563 81624035 A  ERROR'
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:40:24 [DEBUG   ] spawn_process: at 2019-03-21 22:40:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:40:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 22:40:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:40:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 22:40:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:40:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:40:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:40:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:40:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:40:35 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-03-21 22:40:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:41:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:41:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:41:27 [DEBUG   ] Got command BAM from MCS: ref #96355
2019-03-21 22:41:27 [INFO    ] Finished processing BAM request
2019-03-21 22:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96355   8 58563 81687027 A  ERROR'
2019-03-21 22:41:27 [DEBUG   ] Got command BAM from MCS: ref #96354
2019-03-21 22:41:27 [INFO    ] Finished processing BAM request
2019-03-21 22:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96354   8 58563 81687031 A  ERROR'
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:41:27 [DEBUG   ] spawn_process: at 2019-03-21 22:41:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:41:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:41:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:41:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:41:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:41:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:41:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:41:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:41:35 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-03-21 22:41:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:41:48 [DEBUG   ] Got command RPT from MCS: ref #96356
2019-03-21 22:41:48 [DEBUG   ] summary = ERROR
2019-03-21 22:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96356  13 58563 81708031 A  ERRORERROR'
2019-03-21 22:41:48 [DEBUG   ] Got command RPT from MCS: ref #96357
2019-03-21 22:41:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96357  77 58563 81708235 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:41:48 [DEBUG   ] Got command RPT from MCS: ref #96358
2019-03-21 22:41:48 [DEBUG   ] summary = ERROR
2019-03-21 22:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96358  13 58563 81708427 A  ERRORERROR'
2019-03-21 22:41:48 [DEBUG   ] Got command RPT from MCS: ref #96359
2019-03-21 22:41:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96359  77 58563 81708631 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:41:48 [DEBUG   ] Got command RPT from MCS: ref #96360
2019-03-21 22:41:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96360  12 58563 81708835 A  ERRORBœ™š'
2019-03-21 22:42:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 22:42:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:42:30 [DEBUG   ] Got command BAM from MCS: ref #96368
2019-03-21 22:42:30 [INFO    ] Finished processing BAM request
2019-03-21 22:42:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96368   8 58563 81750031 A  ERROR'
2019-03-21 22:42:30 [DEBUG   ] Got command BAM from MCS: ref #96367
2019-03-21 22:42:30 [INFO    ] Finished processing BAM request
2019-03-21 22:42:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96367   8 58563 81750035 A  ERROR'
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:42:30 [DEBUG   ] spawn_process: at 2019-03-21 22:42:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:42:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:42:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:42:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 22:42:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:42:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:42:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:42:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:42:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:42:35 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-03-21 22:42:40 [DEBUG   ] Got command RPT from MCS: ref #96369
2019-03-21 22:42:40 [DEBUG   ] summary = ERROR
2019-03-21 22:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96369  13 58563 81760883 A  ERRORERROR'
2019-03-21 22:42:40 [DEBUG   ] Got command RPT from MCS: ref #96370
2019-03-21 22:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96370  77 58563 81760883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:42:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:43:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:43:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 22:43:33 [DEBUG   ] Got command BAM from MCS: ref #96386
2019-03-21 22:43:33 [INFO    ] Finished processing BAM request
2019-03-21 22:43:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96386   8 58563 81813027 A  ERROR'
2019-03-21 22:43:33 [DEBUG   ] Got command BAM from MCS: ref #96387
2019-03-21 22:43:33 [INFO    ] Finished processing BAM request
2019-03-21 22:43:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96387   8 58563 81813031 A  ERROR'
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 22:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 22:43:33 [DEBUG   ] spawn_process: at 2019-03-21 22:43:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 22:43:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:43:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-03-21 22:43:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:43:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:43:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:43:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:43:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:43:35 [DEBUG   ] Finished updating board flags in 0.987 seconds
2019-03-21 22:43:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:44:05 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 22:44:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 22:44:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:44:36 [DEBUG   ] Got command BAM from MCS: ref #96389
2019-03-21 22:44:36 [INFO    ] Finished processing BAM request
2019-03-21 22:44:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96389   8 58563 81876039 A  ERROR'
2019-03-21 22:44:36 [DEBUG   ] Got command BAM from MCS: ref #96388
2019-03-21 22:44:36 [INFO    ] Finished processing BAM request
2019-03-21 22:44:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96388   8 58563 81876047 A  ERROR'
2019-03-21 22:44:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:44:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:44:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:44:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:44:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:44:36 [DEBUG   ] Finished updating board flags in 1.886 seconds
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:44:36 [DEBUG   ] spawn_process: at 2019-03-21 22:44:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:44:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:45:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:45:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:45:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:45:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:45:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:45:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:45:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:45:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:45:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:45:35 [DEBUG   ] Finished updating board flags in 1.169 seconds
2019-03-21 22:45:40 [DEBUG   ] Got command BAM from MCS: ref #96397
2019-03-21 22:45:40 [INFO    ] Finished processing BAM request
2019-03-21 22:45:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96397   8 58563 81940027 A  ERROR'
2019-03-21 22:45:40 [DEBUG   ] Got command BAM from MCS: ref #96396
2019-03-21 22:45:40 [INFO    ] Finished processing BAM request
2019-03-21 22:45:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:45:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96396   8 58563 81940031 A  ERROR'
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:45:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:45:40 [DEBUG   ] spawn_process: at 2019-03-21 22:45:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:45:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:46:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 22:46:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:46:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:46:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:46:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:46:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:46:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:46:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:46:35 [DEBUG   ] Finished updating board flags in 1.028 seconds
2019-03-21 22:46:44 [DEBUG   ] Got command BAM from MCS: ref #96398
2019-03-21 22:46:44 [INFO    ] Finished processing BAM request
2019-03-21 22:46:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96398   8 58563 82004035 A  ERROR'
2019-03-21 22:46:44 [DEBUG   ] Got command BAM from MCS: ref #96399
2019-03-21 22:46:44 [INFO    ] Finished processing BAM request
2019-03-21 22:46:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96399   8 58563 82004039 A  ERROR'
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 22:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 22:46:44 [DEBUG   ] spawn_process: at 2019-03-21 22:46:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 22:46:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:46:48 [DEBUG   ] Got command RPT from MCS: ref #96402
2019-03-21 22:46:48 [DEBUG   ] summary = ERROR
2019-03-21 22:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96402  13 58563 82008119 A  ERRORERROR'
2019-03-21 22:46:48 [DEBUG   ] Got command RPT from MCS: ref #96403
2019-03-21 22:46:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96403  77 58563 82008311 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:46:48 [DEBUG   ] Got command RPT from MCS: ref #96404
2019-03-21 22:46:48 [DEBUG   ] summary = ERROR
2019-03-21 22:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96404  13 58563 82008515 A  ERRORERROR'
2019-03-21 22:46:48 [DEBUG   ] Got command RPT from MCS: ref #96406
2019-03-21 22:46:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96406  77 58563 82008719 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:46:48 [DEBUG   ] Got command RPT from MCS: ref #96407
2019-03-21 22:46:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96407  12 58563 82008923 A  ERRORBœ™š'
2019-03-21 22:47:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:47:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:47:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:47:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:47:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:47:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:47:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:47:35 [WARNING ] (13, 1, 'bot')
2019-03-21 22:47:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:47:35 [DEBUG   ] Finished updating board flags in 0.997 seconds
2019-03-21 22:47:40 [DEBUG   ] Got command RPT from MCS: ref #96412
2019-03-21 22:47:40 [DEBUG   ] summary = ERROR
2019-03-21 22:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96412  13 58563 82060887 A  ERRORERROR'
2019-03-21 22:47:40 [DEBUG   ] Got command RPT from MCS: ref #96413
2019-03-21 22:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96413  77 58563 82060887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:47:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:47:47 [DEBUG   ] Got command BAM from MCS: ref #96430
2019-03-21 22:47:47 [INFO    ] Finished processing BAM request
2019-03-21 22:47:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:47:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96430   8 58563 82067035 A  ERROR'
2019-03-21 22:47:47 [DEBUG   ] Got command BAM from MCS: ref #96429
2019-03-21 22:47:47 [INFO    ] Finished processing BAM request
2019-03-21 22:47:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:47:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96429   8 58563 82067039 A  ERROR'
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:47:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:47:47 [DEBUG   ] spawn_process: at 2019-03-21 22:47:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:48:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:48:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:48:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:48:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:48:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:48:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:48:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:48:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:48:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:48:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:48:36 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-03-21 22:48:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 22:48:50 [DEBUG   ] Got command BAM from MCS: ref #96438
2019-03-21 22:48:50 [INFO    ] Finished processing BAM request
2019-03-21 22:48:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96438   8 58563 82130035 A  ERROR'
2019-03-21 22:48:50 [DEBUG   ] Got command BAM from MCS: ref #96437
2019-03-21 22:48:50 [INFO    ] Finished processing BAM request
2019-03-21 22:48:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96437   8 58563 82130039 A  ERROR'
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:48:50 [DEBUG   ] spawn_process: at 2019-03-21 22:48:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:49:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 22:49:26 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-03-21 22:49:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:49:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:49:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:49:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:49:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:49:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:49:36 [DEBUG   ] Finished updating board flags in 1.198 seconds
2019-03-21 22:49:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:49:53 [DEBUG   ] Got command BAM from MCS: ref #96440
2019-03-21 22:49:53 [INFO    ] Finished processing BAM request
2019-03-21 22:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96440   8 58563 82193035 A  ERROR'
2019-03-21 22:49:53 [DEBUG   ] Got command BAM from MCS: ref #96439
2019-03-21 22:49:53 [INFO    ] Finished processing BAM request
2019-03-21 22:49:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96439   8 58563 82193039 A  ERROR'
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:49:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:49:53 [DEBUG   ] spawn_process: at 2019-03-21 22:49:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:50:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 22:50:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:50:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:50:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:50:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:50:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:50:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:50:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:50:36 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-03-21 22:50:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:50:56 [DEBUG   ] Got command BAM from MCS: ref #96447
2019-03-21 22:50:56 [INFO    ] Finished processing BAM request
2019-03-21 22:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96447   8 58563 82256027 A  ERROR'
2019-03-21 22:50:56 [DEBUG   ] Got command BAM from MCS: ref #96448
2019-03-21 22:50:56 [INFO    ] Finished processing BAM request
2019-03-21 22:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96448   8 58563 82256031 A  ERROR'
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:50:56 [DEBUG   ] spawn_process: at 2019-03-21 22:50:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:51:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:51:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:51:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:51:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:51:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:51:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:51:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:51:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:51:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:51:37 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-03-21 22:51:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:51:48 [DEBUG   ] Got command RPT from MCS: ref #96449
2019-03-21 22:51:48 [DEBUG   ] summary = ERROR
2019-03-21 22:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96449  13 58563 82308195 A  ERRORERROR'
2019-03-21 22:51:48 [DEBUG   ] Got command RPT from MCS: ref #96450
2019-03-21 22:51:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96450  77 58563 82308399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:51:48 [DEBUG   ] Got command RPT from MCS: ref #96451
2019-03-21 22:51:48 [DEBUG   ] summary = ERROR
2019-03-21 22:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96451  13 58563 82308603 A  ERRORERROR'
2019-03-21 22:51:48 [DEBUG   ] Got command RPT from MCS: ref #96452
2019-03-21 22:51:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96452  77 58563 82308807 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:51:48 [DEBUG   ] Got command RPT from MCS: ref #96453
2019-03-21 22:51:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96453  12 58563 82308999 A  ERRORBœ™š'
2019-03-21 22:51:59 [DEBUG   ] Got command BAM from MCS: ref #96455
2019-03-21 22:51:59 [INFO    ] Finished processing BAM request
2019-03-21 22:51:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96455   8 58563 82319035 A  ERROR'
2019-03-21 22:51:59 [DEBUG   ] Got command BAM from MCS: ref #96454
2019-03-21 22:51:59 [INFO    ] Finished processing BAM request
2019-03-21 22:51:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96454   8 58563 82319039 A  ERROR'
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:51:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:51:59 [DEBUG   ] spawn_process: at 2019-03-21 22:51:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:52:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:52:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:52:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:52:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:52:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:52:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:52:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:52:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:52:36 [DEBUG   ] Finished updating board flags in 1.237 seconds
2019-03-21 22:52:40 [DEBUG   ] Got command RPT from MCS: ref #96456
2019-03-21 22:52:40 [DEBUG   ] summary = ERROR
2019-03-21 22:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96456  13 58563 82360891 A  ERRORERROR'
2019-03-21 22:52:40 [DEBUG   ] Got command RPT from MCS: ref #96457
2019-03-21 22:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96457  77 58563 82360891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:52:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:53:02 [DEBUG   ] Got command BAM from MCS: ref #96473
2019-03-21 22:53:02 [INFO    ] Finished processing BAM request
2019-03-21 22:53:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:53:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96473   8 58563 82382031 A  ERROR'
2019-03-21 22:53:02 [DEBUG   ] Got command BAM from MCS: ref #96474
2019-03-21 22:53:02 [INFO    ] Finished processing BAM request
2019-03-21 22:53:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:53:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96474   8 58563 82382035 A  ERROR'
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:53:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:53:02 [DEBUG   ] spawn_process: at 2019-03-21 22:53:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:53:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:53:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:53:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:53:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 22:53:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:53:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:53:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:53:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:53:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:53:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:53:36 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-03-21 22:53:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 22:54:05 [DEBUG   ] Got command BAM from MCS: ref #96482
2019-03-21 22:54:05 [INFO    ] Finished processing BAM request
2019-03-21 22:54:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96482   8 58563 82445027 A  ERROR'
2019-03-21 22:54:05 [DEBUG   ] Got command BAM from MCS: ref #96481
2019-03-21 22:54:05 [INFO    ] Finished processing BAM request
2019-03-21 22:54:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96481   8 58563 82445031 A  ERROR'
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:54:05 [DEBUG   ] spawn_process: at 2019-03-21 22:54:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:54:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 22:54:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 22:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:54:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:54:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:54:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:54:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:54:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:54:36 [DEBUG   ] Finished updating board flags in 1.197 seconds
2019-03-21 22:54:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:55:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:55:08 [DEBUG   ] Got command BAM from MCS: ref #96484
2019-03-21 22:55:08 [INFO    ] Finished processing BAM request
2019-03-21 22:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96484   8 58563 82508027 A  ERROR'
2019-03-21 22:55:08 [DEBUG   ] Got command BAM from MCS: ref #96483
2019-03-21 22:55:08 [INFO    ] Finished processing BAM request
2019-03-21 22:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96483   8 58563 82508031 A  ERROR'
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 22:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 22:55:08 [DEBUG   ] spawn_process: at 2019-03-21 22:55:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 22:55:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 22:55:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:55:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:55:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:55:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:55:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:55:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:55:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:55:36 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-03-21 22:55:46 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-03-21 22:56:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:56:11 [DEBUG   ] Got command BAM from MCS: ref #96486
2019-03-21 22:56:11 [INFO    ] Finished processing BAM request
2019-03-21 22:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96486   8 58563 82571035 A  ERROR'
2019-03-21 22:56:11 [DEBUG   ] Got command BAM from MCS: ref #96485
2019-03-21 22:56:11 [INFO    ] Finished processing BAM request
2019-03-21 22:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96485   8 58563 82571039 A  ERROR'
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:56:11 [DEBUG   ] spawn_process: at 2019-03-21 22:56:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:56:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:56:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 22:56:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:56:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 22:56:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-03-21 22:56:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:56:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:56:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:56:36 [WARNING ] (13, 1, 'bot')
2019-03-21 22:56:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:56:36 [DEBUG   ] Finished updating board flags in 0.991 seconds
2019-03-21 22:56:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 22:56:48 [DEBUG   ] Got command RPT from MCS: ref #96489
2019-03-21 22:56:48 [DEBUG   ] summary = ERROR
2019-03-21 22:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96489  13 58563 82608287 A  ERRORERROR'
2019-03-21 22:56:48 [DEBUG   ] Got command RPT from MCS: ref #96490
2019-03-21 22:56:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96490  77 58563 82608491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:56:48 [DEBUG   ] Got command RPT from MCS: ref #96491
2019-03-21 22:56:48 [DEBUG   ] summary = ERROR
2019-03-21 22:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96491  13 58563 82608683 A  ERRORERROR'
2019-03-21 22:56:48 [DEBUG   ] Got command RPT from MCS: ref #96493
2019-03-21 22:56:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96493  77 58563 82608887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:56:49 [DEBUG   ] Got command RPT from MCS: ref #96495
2019-03-21 22:56:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 22:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96495  12 58563 82609091 A  ERRORBœ™š'
2019-03-21 22:57:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 22:57:14 [DEBUG   ] Got command BAM from MCS: ref #96505
2019-03-21 22:57:14 [INFO    ] Finished processing BAM request
2019-03-21 22:57:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96505   8 58563 82634031 A  ERROR'
2019-03-21 22:57:14 [DEBUG   ] Got command BAM from MCS: ref #96506
2019-03-21 22:57:14 [INFO    ] Finished processing BAM request
2019-03-21 22:57:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96506   8 58563 82634035 A  ERROR'
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:57:14 [DEBUG   ] spawn_process: at 2019-03-21 22:57:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:57:26 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 22:57:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:57:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:57:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:57:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:57:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:57:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:57:37 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-03-21 22:57:40 [DEBUG   ] Got command RPT from MCS: ref #96507
2019-03-21 22:57:40 [DEBUG   ] summary = ERROR
2019-03-21 22:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96507  13 58563 82660883 A  ERRORERROR'
2019-03-21 22:57:40 [DEBUG   ] Got command RPT from MCS: ref #96508
2019-03-21 22:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 22:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96508  77 58563 82660883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 22:57:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:58:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:58:17 [DEBUG   ] Got command BAM from MCS: ref #96525
2019-03-21 22:58:17 [INFO    ] Finished processing BAM request
2019-03-21 22:58:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96525   8 58563 82697031 A  ERROR'
2019-03-21 22:58:17 [DEBUG   ] Got command BAM from MCS: ref #96524
2019-03-21 22:58:17 [INFO    ] Finished processing BAM request
2019-03-21 22:58:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96524   8 58563 82697035 A  ERROR'
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 22:58:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 22:58:17 [DEBUG   ] spawn_process: at 2019-03-21 22:58:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 22:58:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:58:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:58:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:58:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:58:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:58:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:58:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:58:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:58:37 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-03-21 22:58:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:59:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 22:59:20 [DEBUG   ] Got command BAM from MCS: ref #96527
2019-03-21 22:59:20 [INFO    ] Finished processing BAM request
2019-03-21 22:59:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96527   8 58563 82760031 A  ERROR'
2019-03-21 22:59:20 [DEBUG   ] Got command BAM from MCS: ref #96526
2019-03-21 22:59:20 [INFO    ] Finished processing BAM request
2019-03-21 22:59:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 22:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96526   8 58563 82760035 A  ERROR'
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 22:59:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 22:59:20 [DEBUG   ] spawn_process: at 2019-03-21 22:59:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 22:59:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 22:59:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 22:59:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 22:59:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 22:59:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:59:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:59:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:59:37 [WARNING ] (13, 1, 'bot')
2019-03-21 22:59:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 22:59:37 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-03-21 22:59:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:00:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:00:22 [DEBUG   ] Got command BAM from MCS: ref #96535
2019-03-21 23:00:22 [INFO    ] Finished processing BAM request
2019-03-21 23:00:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96535   8 58563 82822027 A  ERROR'
2019-03-21 23:00:22 [DEBUG   ] Got command BAM from MCS: ref #96534
2019-03-21 23:00:22 [INFO    ] Finished processing BAM request
2019-03-21 23:00:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96534   8 58563 82822031 A  ERROR'
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:00:22 [DEBUG   ] spawn_process: at 2019-03-21 23:00:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:00:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:00:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:00:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:00:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:00:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:00:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:00:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:00:37 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-03-21 23:00:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:01:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:01:24 [DEBUG   ] Got command BAM from MCS: ref #96537
2019-03-21 23:01:24 [INFO    ] Finished processing BAM request
2019-03-21 23:01:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96537   8 58563 82884035 A  ERROR'
2019-03-21 23:01:24 [DEBUG   ] Got command BAM from MCS: ref #96536
2019-03-21 23:01:24 [INFO    ] Finished processing BAM request
2019-03-21 23:01:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96536   8 58563 82884039 A  ERROR'
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:01:24 [DEBUG   ] spawn_process: at 2019-03-21 23:01:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:01:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:01:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:01:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:01:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:01:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:01:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:01:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:01:37 [DEBUG   ] Finished updating board flags in 0.999 seconds
2019-03-21 23:01:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:01:48 [DEBUG   ] Got command RPT from MCS: ref #96538
2019-03-21 23:01:48 [DEBUG   ] summary = ERROR
2019-03-21 23:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96538  13 58563 82908375 A  ERRORERROR'
2019-03-21 23:01:48 [DEBUG   ] Got command RPT from MCS: ref #96539
2019-03-21 23:01:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96539  77 58563 82908567 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:01:48 [DEBUG   ] Got command RPT from MCS: ref #96540
2019-03-21 23:01:48 [DEBUG   ] summary = ERROR
2019-03-21 23:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96540  13 58563 82908771 A  ERRORERROR'
2019-03-21 23:01:48 [DEBUG   ] Got command RPT from MCS: ref #96541
2019-03-21 23:01:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96541  77 58563 82908975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:01:49 [DEBUG   ] Got command RPT from MCS: ref #96542
2019-03-21 23:01:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96542  12 58563 82909179 A  ERRORBœ™š'
2019-03-21 23:02:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:02:26 [DEBUG   ] Got command BAM from MCS: ref #96544
2019-03-21 23:02:26 [INFO    ] Finished processing BAM request
2019-03-21 23:02:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96544   8 58563 82946035 A  ERROR'
2019-03-21 23:02:26 [DEBUG   ] Got command BAM from MCS: ref #96543
2019-03-21 23:02:26 [INFO    ] Finished processing BAM request
2019-03-21 23:02:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96543   8 58563 82946039 A  ERROR'
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:02:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:02:26 [DEBUG   ] spawn_process: at 2019-03-21 23:02:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:02:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:02:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:02:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:02:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:02:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:02:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:02:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:02:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:02:37 [DEBUG   ] Finished updating board flags in 1.259 seconds
2019-03-21 23:02:40 [DEBUG   ] Got command RPT from MCS: ref #96545
2019-03-21 23:02:40 [DEBUG   ] summary = ERROR
2019-03-21 23:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96545  13 58563 82960887 A  ERRORERROR'
2019-03-21 23:02:40 [DEBUG   ] Got command RPT from MCS: ref #96546
2019-03-21 23:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96546  77 58563 82960887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:02:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 23:03:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 23:03:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 23:03:28 [DEBUG   ] Got command BAM from MCS: ref #96569
2019-03-21 23:03:28 [INFO    ] Finished processing BAM request
2019-03-21 23:03:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96569   8 58563 83008031 A  ERROR'
2019-03-21 23:03:28 [DEBUG   ] Got command BAM from MCS: ref #96568
2019-03-21 23:03:28 [INFO    ] Finished processing BAM request
2019-03-21 23:03:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96568   8 58563 83008035 A  ERROR'
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:03:28 [DEBUG   ] spawn_process: at 2019-03-21 23:03:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:03:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:03:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:03:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 23:03:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:03:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:03:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:03:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:03:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:03:37 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-03-21 23:03:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 23:04:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 23:04:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 23:04:30 [DEBUG   ] Got command BAM from MCS: ref #96571
2019-03-21 23:04:30 [INFO    ] Finished processing BAM request
2019-03-21 23:04:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96571   8 58563 83070027 A  ERROR'
2019-03-21 23:04:30 [DEBUG   ] Got command BAM from MCS: ref #96570
2019-03-21 23:04:30 [INFO    ] Finished processing BAM request
2019-03-21 23:04:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96570   8 58563 83070031 A  ERROR'
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 23:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 23:04:30 [DEBUG   ] spawn_process: at 2019-03-21 23:04:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 23:04:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:04:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:04:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:04:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:04:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:04:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:04:37 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-03-21 23:04:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 23:05:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 23:05:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 23:05:32 [DEBUG   ] Got command BAM from MCS: ref #96573
2019-03-21 23:05:32 [INFO    ] Finished processing BAM request
2019-03-21 23:05:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:05:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96573   8 58563 83132027 A  ERROR'
2019-03-21 23:05:32 [DEBUG   ] Got command BAM from MCS: ref #96572
2019-03-21 23:05:32 [INFO    ] Finished processing BAM request
2019-03-21 23:05:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:05:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96572   8 58563 83132031 A  ERROR'
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:05:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:05:32 [DEBUG   ] spawn_process: at 2019-03-21 23:05:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:05:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:05:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 23:05:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:05:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:05:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:05:37 [WARNING ] (13, 1, 'bot')
2019-03-21 23:05:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:05:37 [DEBUG   ] Finished updating board flags in 0.986 seconds
2019-03-21 23:05:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 23:06:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 23:06:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 23:06:34 [DEBUG   ] Got command BAM from MCS: ref #96580
2019-03-21 23:06:34 [INFO    ] Finished processing BAM request
2019-03-21 23:06:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96580   8 58563 83194035 A  ERROR'
2019-03-21 23:06:34 [DEBUG   ] Got command BAM from MCS: ref #96581
2019-03-21 23:06:34 [INFO    ] Finished processing BAM request
2019-03-21 23:06:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96581   8 58563 83194039 A  ERROR'
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:06:34 [DEBUG   ] spawn_process: at 2019-03-21 23:06:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:06:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 23:06:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:06:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:06:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:06:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:06:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:06:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:06:38 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-03-21 23:06:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 23:06:48 [DEBUG   ] Got command RPT from MCS: ref #96584
2019-03-21 23:06:48 [DEBUG   ] summary = ERROR
2019-03-21 23:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96584  13 58563 83208455 A  ERRORERROR'
2019-03-21 23:06:48 [DEBUG   ] Got command RPT from MCS: ref #96585
2019-03-21 23:06:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96585  77 58563 83208659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:06:48 [DEBUG   ] Got command RPT from MCS: ref #96586
2019-03-21 23:06:48 [DEBUG   ] summary = ERROR
2019-03-21 23:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96586  13 58563 83208851 A  ERRORERROR'
2019-03-21 23:06:49 [DEBUG   ] Got command RPT from MCS: ref #96588
2019-03-21 23:06:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96588  77 58563 83209055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:06:49 [DEBUG   ] Got command RPT from MCS: ref #96590
2019-03-21 23:06:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96590  12 58563 83209259 A  ERRORB›™š'
2019-03-21 23:07:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 23:07:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:07:36 [DEBUG   ] Got command BAM from MCS: ref #96594
2019-03-21 23:07:36 [INFO    ] Finished processing BAM request
2019-03-21 23:07:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96594   8 58563 83256031 A  ERROR'
2019-03-21 23:07:36 [DEBUG   ] Got command BAM from MCS: ref #96595
2019-03-21 23:07:36 [INFO    ] Finished processing BAM request
2019-03-21 23:07:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96595   8 58563 83256035 A  ERROR'
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 23:07:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 23:07:36 [DEBUG   ] spawn_process: at 2019-03-21 23:07:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 23:07:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:07:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:07:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:07:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:07:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:07:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:07:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:07:38 [DEBUG   ] Finished updating board flags in 1.198 seconds
2019-03-21 23:07:40 [DEBUG   ] Got command RPT from MCS: ref #96596
2019-03-21 23:07:40 [DEBUG   ] summary = ERROR
2019-03-21 23:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96596  13 58563 83260891 A  ERRORERROR'
2019-03-21 23:07:40 [DEBUG   ] Got command RPT from MCS: ref #96597
2019-03-21 23:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96597  77 58563 83260891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:07:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:08:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:08:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:08:38 [DEBUG   ] Got command BAM from MCS: ref #96613
2019-03-21 23:08:38 [INFO    ] Finished processing BAM request
2019-03-21 23:08:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96613   8 58563 83318031 A  ERROR'
2019-03-21 23:08:38 [DEBUG   ] Got command BAM from MCS: ref #96614
2019-03-21 23:08:38 [INFO    ] Finished processing BAM request
2019-03-21 23:08:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96614   8 58563 83318039 A  ERROR'
2019-03-21 23:08:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:08:38 [DEBUG   ] spawn_process: at 2019-03-21 23:08:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:08:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:08:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:08:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:08:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:08:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:08:39 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-03-21 23:08:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:09:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:09:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:09:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:09:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:09:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:09:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:09:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:09:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:09:38 [DEBUG   ] Finished updating board flags in 1.454 seconds
2019-03-21 23:09:40 [DEBUG   ] Got command BAM from MCS: ref #96621
2019-03-21 23:09:40 [INFO    ] Finished processing BAM request
2019-03-21 23:09:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96621   8 58563 83380031 A  ERROR'
2019-03-21 23:09:40 [DEBUG   ] Got command BAM from MCS: ref #96622
2019-03-21 23:09:40 [INFO    ] Finished processing BAM request
2019-03-21 23:09:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96622   8 58563 83380035 A  ERROR'
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 23:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 23:09:40 [DEBUG   ] spawn_process: at 2019-03-21 23:09:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 23:09:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:10:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:10:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:10:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:10:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:10:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:10:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:10:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:10:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:10:38 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-03-21 23:10:42 [DEBUG   ] Got command BAM from MCS: ref #96624
2019-03-21 23:10:42 [INFO    ] Finished processing BAM request
2019-03-21 23:10:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:10:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96624   8 58563 83442027 A  ERROR'
2019-03-21 23:10:42 [DEBUG   ] Got command BAM from MCS: ref #96623
2019-03-21 23:10:42 [INFO    ] Finished processing BAM request
2019-03-21 23:10:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:10:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96623   8 58563 83442031 A  ERROR'
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:10:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:10:42 [DEBUG   ] spawn_process: at 2019-03-21 23:10:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:10:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:11:07 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:11:27 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 23:11:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:11:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:11:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:11:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:11:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:11:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:11:38 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-03-21 23:11:44 [DEBUG   ] Got command BAM from MCS: ref #96626
2019-03-21 23:11:44 [INFO    ] Finished processing BAM request
2019-03-21 23:11:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96626   8 58563 83504031 A  ERROR'
2019-03-21 23:11:44 [DEBUG   ] Got command BAM from MCS: ref #96625
2019-03-21 23:11:44 [INFO    ] Finished processing BAM request
2019-03-21 23:11:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96625   8 58563 83504035 A  ERROR'
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:11:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:11:44 [DEBUG   ] spawn_process: at 2019-03-21 23:11:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:11:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:11:48 [DEBUG   ] Got command RPT from MCS: ref #96627
2019-03-21 23:11:48 [DEBUG   ] summary = ERROR
2019-03-21 23:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96627  13 58563 83508535 A  ERRORERROR'
2019-03-21 23:11:48 [DEBUG   ] Got command RPT from MCS: ref #96628
2019-03-21 23:11:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96628  77 58563 83508739 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:11:48 [DEBUG   ] Got command RPT from MCS: ref #96629
2019-03-21 23:11:48 [DEBUG   ] summary = ERROR
2019-03-21 23:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96629  13 58563 83508943 A  ERRORERROR'
2019-03-21 23:11:49 [DEBUG   ] Got command RPT from MCS: ref #96630
2019-03-21 23:11:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96630  77 58563 83509147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:11:49 [DEBUG   ] Got command RPT from MCS: ref #96631
2019-03-21 23:11:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96631  12 58563 83509339 A  ERRORBœ™š'
2019-03-21 23:12:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:12:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:12:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 23:12:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:12:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:12:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:12:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:12:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:12:39 [DEBUG   ] Finished updating board flags in 1.930 seconds
2019-03-21 23:12:40 [DEBUG   ] Got command RPT from MCS: ref #96638
2019-03-21 23:12:40 [DEBUG   ] summary = ERROR
2019-03-21 23:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96638  13 58563 83560895 A  ERRORERROR'
2019-03-21 23:12:40 [DEBUG   ] Got command RPT from MCS: ref #96639
2019-03-21 23:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96639  77 58563 83560895 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:12:46 [DEBUG   ] Got command BAM from MCS: ref #96655
2019-03-21 23:12:46 [INFO    ] Finished processing BAM request
2019-03-21 23:12:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:12:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96655   8 58563 83566027 A  ERROR'
2019-03-21 23:12:46 [DEBUG   ] Got command BAM from MCS: ref #96656
2019-03-21 23:12:46 [INFO    ] Finished processing BAM request
2019-03-21 23:12:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:12:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96656   8 58563 83566031 A  ERROR'
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:12:46 [DEBUG   ] spawn_process: at 2019-03-21 23:12:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:12:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:13:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:13:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:13:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:13:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 23:13:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:13:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:13:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:13:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:13:38 [WARNING ] (13, 1, 'bot')
2019-03-21 23:13:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:13:38 [DEBUG   ] Finished updating board flags in 1.239 seconds
2019-03-21 23:13:48 [DEBUG   ] Got command BAM from MCS: ref #96657
2019-03-21 23:13:48 [INFO    ] Finished processing BAM request
2019-03-21 23:13:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:13:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96657   8 58563 83628035 A  ERROR'
2019-03-21 23:13:48 [DEBUG   ] Got command BAM from MCS: ref #96658
2019-03-21 23:13:48 [INFO    ] Finished processing BAM request
2019-03-21 23:13:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:13:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96658   8 58563 83628039 A  ERROR'
2019-03-21 23:13:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:13:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:13:48 [DEBUG   ] spawn_process: at 2019-03-21 23:13:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:14:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:14:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:14:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:14:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:14:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:14:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:14:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:14:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:14:39 [DEBUG   ] Finished updating board flags in 1.774 seconds
2019-03-21 23:14:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-21 23:14:50 [DEBUG   ] Got command BAM from MCS: ref #96659
2019-03-21 23:14:50 [INFO    ] Finished processing BAM request
2019-03-21 23:14:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96659   8 58563 83690035 A  ERROR'
2019-03-21 23:14:50 [DEBUG   ] Got command BAM from MCS: ref #96660
2019-03-21 23:14:50 [INFO    ] Finished processing BAM request
2019-03-21 23:14:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96660   8 58563 83690039 A  ERROR'
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:14:50 [DEBUG   ] spawn_process: at 2019-03-21 23:14:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:15:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 23:15:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:15:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:15:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 23:15:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:15:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:15:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:15:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:15:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:15:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:15:39 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-03-21 23:15:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:15:51 [DEBUG   ] Got command BAM from MCS: ref #96668
2019-03-21 23:15:51 [INFO    ] Finished processing BAM request
2019-03-21 23:15:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:15:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96668   8 58563 83751035 A  ERROR'
2019-03-21 23:15:51 [DEBUG   ] Got command BAM from MCS: ref #96667
2019-03-21 23:15:51 [INFO    ] Finished processing BAM request
2019-03-21 23:15:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:15:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96667   8 58563 83751039 A  ERROR'
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:15:51 [DEBUG   ] spawn_process: at 2019-03-21 23:15:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:16:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:16:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:16:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:16:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 23:16:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:16:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:16:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:16:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:16:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:16:39 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-03-21 23:16:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 23:16:48 [DEBUG   ] Got command RPT from MCS: ref #96671
2019-03-21 23:16:48 [DEBUG   ] summary = ERROR
2019-03-21 23:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96671  13 58563 83808623 A  ERRORERROR'
2019-03-21 23:16:48 [DEBUG   ] Got command RPT from MCS: ref #96672
2019-03-21 23:16:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96672  77 58563 83808827 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:16:49 [DEBUG   ] Got command RPT from MCS: ref #96673
2019-03-21 23:16:49 [DEBUG   ] summary = ERROR
2019-03-21 23:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96673  13 58563 83809019 A  ERRORERROR'
2019-03-21 23:16:49 [DEBUG   ] Got command RPT from MCS: ref #96675
2019-03-21 23:16:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96675  77 58563 83809223 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:16:49 [DEBUG   ] Got command RPT from MCS: ref #96676
2019-03-21 23:16:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96676  12 58563 83809427 A  ERRORB›™š'
2019-03-21 23:16:52 [DEBUG   ] Got command BAM from MCS: ref #96682
2019-03-21 23:16:52 [INFO    ] Finished processing BAM request
2019-03-21 23:16:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96682   8 58563 83812035 A  ERROR'
2019-03-21 23:16:52 [DEBUG   ] Got command BAM from MCS: ref #96681
2019-03-21 23:16:52 [INFO    ] Finished processing BAM request
2019-03-21 23:16:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96681   8 58563 83812039 A  ERROR'
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 23:16:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 23:16:52 [DEBUG   ] spawn_process: at 2019-03-21 23:16:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 23:17:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 23:17:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 23:17:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:17:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:17:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:17:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:17:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:17:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:17:39 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-03-21 23:17:40 [DEBUG   ] Got command RPT from MCS: ref #96683
2019-03-21 23:17:40 [DEBUG   ] summary = ERROR
2019-03-21 23:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96683  13 58563 83860895 A  ERRORERROR'
2019-03-21 23:17:40 [DEBUG   ] Got command RPT from MCS: ref #96684
2019-03-21 23:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96684  77 58563 83860895 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:17:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 23:17:53 [DEBUG   ] Got command BAM from MCS: ref #96706
2019-03-21 23:17:53 [INFO    ] Finished processing BAM request
2019-03-21 23:17:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:17:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96706   8 58563 83873031 A  ERROR'
2019-03-21 23:17:53 [DEBUG   ] Got command BAM from MCS: ref #96707
2019-03-21 23:17:53 [INFO    ] Finished processing BAM request
2019-03-21 23:17:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:17:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96707   8 58563 83873035 A  ERROR'
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:17:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:17:53 [DEBUG   ] spawn_process: at 2019-03-21 23:17:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:18:08 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 23:18:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:18:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:18:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:18:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:18:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:18:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:18:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:18:39 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-03-21 23:18:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:18:54 [DEBUG   ] Got command BAM from MCS: ref #96708
2019-03-21 23:18:54 [INFO    ] Finished processing BAM request
2019-03-21 23:18:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96708   8 58563 83934027 A  ERROR'
2019-03-21 23:18:54 [DEBUG   ] Got command BAM from MCS: ref #96709
2019-03-21 23:18:54 [INFO    ] Finished processing BAM request
2019-03-21 23:18:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96709   8 58563 83934031 A  ERROR'
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 23:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 23:18:54 [DEBUG   ] spawn_process: at 2019-03-21 23:18:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 23:19:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:19:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:19:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:19:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:19:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:19:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:19:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:19:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:19:39 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-03-21 23:19:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:19:55 [DEBUG   ] Got command BAM from MCS: ref #96711
2019-03-21 23:19:55 [INFO    ] Finished processing BAM request
2019-03-21 23:19:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96711   8 58563 83995027 A  ERROR'
2019-03-21 23:19:55 [DEBUG   ] Got command BAM from MCS: ref #96710
2019-03-21 23:19:55 [INFO    ] Finished processing BAM request
2019-03-21 23:19:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96710   8 58563 83995031 A  ERROR'
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:19:55 [DEBUG   ] spawn_process: at 2019-03-21 23:19:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:20:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:20:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:20:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:20:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:20:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:20:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:20:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:20:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:20:39 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-03-21 23:20:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:20:56 [DEBUG   ] Got command BAM from MCS: ref #96719
2019-03-21 23:20:56 [INFO    ] Finished processing BAM request
2019-03-21 23:20:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:20:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96719   8 58563 84056035 A  ERROR'
2019-03-21 23:20:56 [DEBUG   ] Got command BAM from MCS: ref #96718
2019-03-21 23:20:56 [INFO    ] Finished processing BAM request
2019-03-21 23:20:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:20:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96718   8 58563 84056039 A  ERROR'
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:20:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:20:56 [DEBUG   ] spawn_process: at 2019-03-21 23:20:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:21:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:21:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:21:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:21:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:21:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:21:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:21:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:21:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:21:39 [DEBUG   ] Finished updating board flags in 0.991 seconds
2019-03-21 23:21:48 [DEBUG   ] Got command RPT from MCS: ref #96720
2019-03-21 23:21:48 [DEBUG   ] summary = ERROR
2019-03-21 23:21:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96720  13 58563 84108711 A  ERRORERROR'
2019-03-21 23:21:48 [DEBUG   ] Got command RPT from MCS: ref #96721
2019-03-21 23:21:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:21:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96721  77 58563 84108903 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:21:49 [DEBUG   ] Got command RPT from MCS: ref #96722
2019-03-21 23:21:49 [DEBUG   ] summary = ERROR
2019-03-21 23:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96722  13 58563 84109107 A  ERRORERROR'
2019-03-21 23:21:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:21:49 [DEBUG   ] Got command RPT from MCS: ref #96723
2019-03-21 23:21:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96723  77 58563 84109311 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:21:49 [DEBUG   ] Got command RPT from MCS: ref #96724
2019-03-21 23:21:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96724  12 58563 84109515 A  ERRORBœ™š'
2019-03-21 23:21:57 [DEBUG   ] Got command BAM from MCS: ref #96725
2019-03-21 23:21:57 [INFO    ] Finished processing BAM request
2019-03-21 23:21:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96725   8 58563 84117031 A  ERROR'
2019-03-21 23:21:57 [DEBUG   ] Got command BAM from MCS: ref #96726
2019-03-21 23:21:57 [INFO    ] Finished processing BAM request
2019-03-21 23:21:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96726   8 58563 84117035 A  ERROR'
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:21:57 [DEBUG   ] spawn_process: at 2019-03-21 23:21:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:22:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:22:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:22:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:22:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:22:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 23:22:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:22:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:22:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:22:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:22:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:22:39 [DEBUG   ] Finished updating board flags in 1.274 seconds
2019-03-21 23:22:40 [DEBUG   ] Got command RPT from MCS: ref #96727
2019-03-21 23:22:40 [DEBUG   ] summary = ERROR
2019-03-21 23:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96727  13 58563 84160895 A  ERRORERROR'
2019-03-21 23:22:40 [DEBUG   ] Got command RPT from MCS: ref #96728
2019-03-21 23:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96728  77 58563 84160895 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:22:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:22:58 [DEBUG   ] Got command BAM from MCS: ref #96744
2019-03-21 23:22:58 [INFO    ] Finished processing BAM request
2019-03-21 23:22:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:22:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96744   8 58563 84178027 A  ERROR'
2019-03-21 23:22:58 [DEBUG   ] Got command BAM from MCS: ref #96745
2019-03-21 23:22:58 [INFO    ] Finished processing BAM request
2019-03-21 23:22:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:22:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96745   8 58563 84178031 A  ERROR'
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:22:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:22:58 [DEBUG   ] spawn_process: at 2019-03-21 23:22:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:23:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:23:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:23:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:23:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:23:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:23:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:23:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:23:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:23:39 [DEBUG   ] Finished updating board flags in 1.193 seconds
2019-03-21 23:23:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 23:23:59 [DEBUG   ] Got command BAM from MCS: ref #96752
2019-03-21 23:23:59 [INFO    ] Finished processing BAM request
2019-03-21 23:23:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96752   8 58563 84239031 A  ERROR'
2019-03-21 23:23:59 [DEBUG   ] Got command BAM from MCS: ref #96753
2019-03-21 23:23:59 [INFO    ] Finished processing BAM request
2019-03-21 23:23:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96753   8 58563 84239035 A  ERROR'
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:23:59 [DEBUG   ] spawn_process: at 2019-03-21 23:23:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:24:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 23:24:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 23:24:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:24:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:24:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:24:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:24:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:24:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:24:39 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-03-21 23:24:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 23:25:00 [DEBUG   ] Got command BAM from MCS: ref #96755
2019-03-21 23:25:00 [INFO    ] Finished processing BAM request
2019-03-21 23:25:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96755   8 58563 84300023 A  ERROR'
2019-03-21 23:25:00 [DEBUG   ] Got command BAM from MCS: ref #96754
2019-03-21 23:25:00 [INFO    ] Finished processing BAM request
2019-03-21 23:25:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96754   8 58563 84300027 A  ERROR'
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:25:00 [DEBUG   ] spawn_process: at 2019-03-21 23:25:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:25:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 23:25:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 23:25:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:25:39 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 23:25:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:25:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:25:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:25:39 [WARNING ] (13, 1, 'bot')
2019-03-21 23:25:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:25:39 [DEBUG   ] Finished updating board flags in 0.972 seconds
2019-03-21 23:25:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 23:26:01 [DEBUG   ] Got command BAM from MCS: ref #96757
2019-03-21 23:26:01 [INFO    ] Finished processing BAM request
2019-03-21 23:26:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:26:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96757   8 58563 84361031 A  ERROR'
2019-03-21 23:26:01 [DEBUG   ] Got command BAM from MCS: ref #96756
2019-03-21 23:26:01 [INFO    ] Finished processing BAM request
2019-03-21 23:26:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:26:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96756   8 58563 84361035 A  ERROR'
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:26:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:26:01 [DEBUG   ] spawn_process: at 2019-03-21 23:26:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:26:09 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:26:29 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 23:26:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:26:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:26:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:26:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:26:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:26:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:26:40 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-03-21 23:26:48 [DEBUG   ] Got command RPT from MCS: ref #96760
2019-03-21 23:26:48 [DEBUG   ] summary = ERROR
2019-03-21 23:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96760  13 58563 84408787 A  ERRORERROR'
2019-03-21 23:26:48 [DEBUG   ] Got command RPT from MCS: ref #96761
2019-03-21 23:26:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96761  77 58563 84408991 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:26:49 [DEBUG   ] Got command RPT from MCS: ref #96762
2019-03-21 23:26:49 [DEBUG   ] summary = ERROR
2019-03-21 23:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96762  13 58563 84409195 A  ERRORERROR'
2019-03-21 23:26:49 [DEBUG   ] Got command RPT from MCS: ref #96763
2019-03-21 23:26:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96763  77 58563 84409399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:26:49 [DEBUG   ] Got command RPT from MCS: ref #96765
2019-03-21 23:26:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96765  12 58563 84409591 A  ERRORB›™š'
2019-03-21 23:26:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:27:02 [DEBUG   ] Got command BAM from MCS: ref #96777
2019-03-21 23:27:02 [INFO    ] Finished processing BAM request
2019-03-21 23:27:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96777   8 58563 84422031 A  ERROR'
2019-03-21 23:27:02 [DEBUG   ] Got command BAM from MCS: ref #96776
2019-03-21 23:27:02 [INFO    ] Finished processing BAM request
2019-03-21 23:27:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96776   8 58563 84422035 A  ERROR'
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:27:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:27:02 [DEBUG   ] spawn_process: at 2019-03-21 23:27:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:27:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:27:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:27:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:27:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:27:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:27:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:27:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:27:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:27:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:27:40 [DEBUG   ] Finished updating board flags in 1.199 seconds
2019-03-21 23:27:40 [DEBUG   ] Got command RPT from MCS: ref #96778
2019-03-21 23:27:40 [DEBUG   ] summary = ERROR
2019-03-21 23:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96778  13 58563 84460891 A  ERRORERROR'
2019-03-21 23:27:40 [DEBUG   ] Got command RPT from MCS: ref #96779
2019-03-21 23:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96779  77 58563 84460891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:27:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:28:03 [DEBUG   ] Got command BAM from MCS: ref #96796
2019-03-21 23:28:03 [INFO    ] Finished processing BAM request
2019-03-21 23:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96796   8 58563 84483023 A  ERROR'
2019-03-21 23:28:03 [DEBUG   ] Got command BAM from MCS: ref #96795
2019-03-21 23:28:03 [INFO    ] Finished processing BAM request
2019-03-21 23:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96795   8 58563 84483027 A  ERROR'
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:28:03 [DEBUG   ] spawn_process: at 2019-03-21 23:28:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:28:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:28:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:28:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:28:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:28:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:28:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:28:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:28:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:28:40 [DEBUG   ] Finished updating board flags in 0.999 seconds
2019-03-21 23:28:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:29:04 [DEBUG   ] Got command BAM from MCS: ref #96798
2019-03-21 23:29:04 [INFO    ] Finished processing BAM request
2019-03-21 23:29:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:29:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96798   8 58563 84544031 A  ERROR'
2019-03-21 23:29:04 [DEBUG   ] Got command BAM from MCS: ref #96797
2019-03-21 23:29:04 [INFO    ] Finished processing BAM request
2019-03-21 23:29:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:29:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96797   8 58563 84544035 A  ERROR'
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:29:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:29:04 [DEBUG   ] spawn_process: at 2019-03-21 23:29:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:29:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:29:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:29:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:29:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:29:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:29:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:29:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:29:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:29:40 [DEBUG   ] Finished updating board flags in 1.261 seconds
2019-03-21 23:29:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:30:05 [DEBUG   ] Got command BAM from MCS: ref #96805
2019-03-21 23:30:05 [INFO    ] Finished processing BAM request
2019-03-21 23:30:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96805   8 58563 84605031 A  ERROR'
2019-03-21 23:30:05 [DEBUG   ] Got command BAM from MCS: ref #96806
2019-03-21 23:30:05 [INFO    ] Finished processing BAM request
2019-03-21 23:30:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96806   8 58563 84605035 A  ERROR'
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:30:05 [DEBUG   ] spawn_process: at 2019-03-21 23:30:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:30:10 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-21 23:30:30 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2019-03-21 23:30:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:30:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 23:30:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:30:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:30:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:30:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:30:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:30:40 [DEBUG   ] Finished updating board flags in 1.187 seconds
2019-03-21 23:30:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 23:31:06 [DEBUG   ] Got command BAM from MCS: ref #96808
2019-03-21 23:31:06 [INFO    ] Finished processing BAM request
2019-03-21 23:31:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96808   8 58563 84666023 A  ERROR'
2019-03-21 23:31:06 [DEBUG   ] Got command BAM from MCS: ref #96807
2019-03-21 23:31:06 [INFO    ] Finished processing BAM request
2019-03-21 23:31:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:31:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96807   8 58563 84666027 A  ERROR'
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:31:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:31:06 [DEBUG   ] spawn_process: at 2019-03-21 23:31:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:31:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 23:31:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 23:31:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:31:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:31:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:31:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:31:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:31:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:31:40 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-03-21 23:31:48 [DEBUG   ] Got command RPT from MCS: ref #96809
2019-03-21 23:31:48 [DEBUG   ] summary = ERROR
2019-03-21 23:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96809  13 58563 84708883 A  ERRORERROR'
2019-03-21 23:31:49 [DEBUG   ] Got command RPT from MCS: ref #96810
2019-03-21 23:31:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96810  77 58563 84709075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:31:49 [DEBUG   ] Got command RPT from MCS: ref #96811
2019-03-21 23:31:49 [DEBUG   ] summary = ERROR
2019-03-21 23:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96811  13 58563 84709279 A  ERRORERROR'
2019-03-21 23:31:49 [DEBUG   ] Got command RPT from MCS: ref #96812
2019-03-21 23:31:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96812  77 58563 84709483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:31:49 [DEBUG   ] Got command RPT from MCS: ref #96813
2019-03-21 23:31:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96813  12 58563 84709687 A  ERRORBœ™š'
2019-03-21 23:31:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 23:32:07 [DEBUG   ] Got command BAM from MCS: ref #96814
2019-03-21 23:32:07 [INFO    ] Finished processing BAM request
2019-03-21 23:32:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:32:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96814   8 58563 84727031 A  ERROR'
2019-03-21 23:32:07 [DEBUG   ] Got command BAM from MCS: ref #96815
2019-03-21 23:32:07 [INFO    ] Finished processing BAM request
2019-03-21 23:32:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:32:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96815   8 58563 84727035 A  ERROR'
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:32:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:32:07 [DEBUG   ] spawn_process: at 2019-03-21 23:32:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:32:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-21 23:32:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:32:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 23:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:32:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:32:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:32:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:32:40 [WARNING ] (13, 1, 'bot')
2019-03-21 23:32:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:32:40 [DEBUG   ] Finished updating board flags in 0.980 seconds
2019-03-21 23:32:40 [DEBUG   ] Got command RPT from MCS: ref #96816
2019-03-21 23:32:40 [DEBUG   ] summary = ERROR
2019-03-21 23:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96816  13 58563 84760899 A  ERRORERROR'
2019-03-21 23:32:40 [DEBUG   ] Got command RPT from MCS: ref #96817
2019-03-21 23:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96817  77 58563 84760899 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:32:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:33:08 [DEBUG   ] Got command BAM from MCS: ref #96839
2019-03-21 23:33:08 [INFO    ] Finished processing BAM request
2019-03-21 23:33:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96839   8 58563 84788035 A  ERROR'
2019-03-21 23:33:08 [DEBUG   ] Got command BAM from MCS: ref #96840
2019-03-21 23:33:08 [INFO    ] Finished processing BAM request
2019-03-21 23:33:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96840   8 58563 84788039 A  ERROR'
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:33:08 [DEBUG   ] spawn_process: at 2019-03-21 23:33:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:33:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:33:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:33:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:33:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:33:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:33:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:33:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:33:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:33:41 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-03-21 23:33:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:34:09 [DEBUG   ] Got command BAM from MCS: ref #96842
2019-03-21 23:34:09 [INFO    ] Finished processing BAM request
2019-03-21 23:34:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96842   8 58563 84849027 A  ERROR'
2019-03-21 23:34:09 [DEBUG   ] Got command BAM from MCS: ref #96841
2019-03-21 23:34:09 [INFO    ] Finished processing BAM request
2019-03-21 23:34:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96841   8 58563 84849031 A  ERROR'
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:34:09 [DEBUG   ] spawn_process: at 2019-03-21 23:34:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:34:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:34:30 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 23:34:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 23:34:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:34:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 23:34:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:34:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:34:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:34:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:34:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:34:41 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-03-21 23:34:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:35:09 [DEBUG   ] Got command BAM from MCS: ref #96844
2019-03-21 23:35:09 [INFO    ] Finished processing BAM request
2019-03-21 23:35:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96844   8 58563 84909027 A  ERROR'
2019-03-21 23:35:09 [DEBUG   ] Got command BAM from MCS: ref #96843
2019-03-21 23:35:09 [INFO    ] Finished processing BAM request
2019-03-21 23:35:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96843   8 58563 84909031 A  ERROR'
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:35:09 [DEBUG   ] spawn_process: at 2019-03-21 23:35:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:35:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:35:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:35:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:35:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:35:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:35:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:35:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:35:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:35:41 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-03-21 23:35:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:36:09 [DEBUG   ] Got command BAM from MCS: ref #96852
2019-03-21 23:36:09 [INFO    ] Finished processing BAM request
2019-03-21 23:36:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96852   8 58563 84969031 A  ERROR'
2019-03-21 23:36:09 [DEBUG   ] Got command BAM from MCS: ref #96851
2019-03-21 23:36:09 [INFO    ] Finished processing BAM request
2019-03-21 23:36:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:36:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96851   8 58563 84969035 A  ERROR'
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:36:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:36:09 [DEBUG   ] spawn_process: at 2019-03-21 23:36:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:36:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 23:36:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:36:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:36:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:36:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:36:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:36:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:36:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:36:41 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-03-21 23:36:48 [DEBUG   ] Got command RPT from MCS: ref #96855
2019-03-21 23:36:48 [DEBUG   ] summary = ERROR
2019-03-21 23:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96855  13 58563 85008963 A  ERRORERROR'
2019-03-21 23:36:49 [DEBUG   ] Got command RPT from MCS: ref #96856
2019-03-21 23:36:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96856  77 58563 85009155 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:36:49 [DEBUG   ] Got command RPT from MCS: ref #96857
2019-03-21 23:36:49 [DEBUG   ] summary = ERROR
2019-03-21 23:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96857  13 58563 85009359 A  ERRORERROR'
2019-03-21 23:36:49 [DEBUG   ] Got command RPT from MCS: ref #96859
2019-03-21 23:36:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96859  77 58563 85009563 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:36:49 [DEBUG   ] Got command RPT from MCS: ref #96861
2019-03-21 23:36:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96861  12 58563 85009767 A  ERRORBœ™š'
2019-03-21 23:36:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:37:09 [DEBUG   ] Got command BAM from MCS: ref #96865
2019-03-21 23:37:09 [INFO    ] Finished processing BAM request
2019-03-21 23:37:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96865   8 58563 85029027 A  ERROR'
2019-03-21 23:37:09 [DEBUG   ] Got command BAM from MCS: ref #96866
2019-03-21 23:37:09 [INFO    ] Finished processing BAM request
2019-03-21 23:37:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96866   8 58563 85029031 A  ERROR'
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:37:09 [DEBUG   ] spawn_process: at 2019-03-21 23:37:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:37:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 23:37:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:37:40 [DEBUG   ] Got command RPT from MCS: ref #96867
2019-03-21 23:37:40 [DEBUG   ] summary = ERROR
2019-03-21 23:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96867  13 58563 85060891 A  ERRORERROR'
2019-03-21 23:37:40 [DEBUG   ] Got command RPT from MCS: ref #96868
2019-03-21 23:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96868  77 58563 85060891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:37:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:37:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:37:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:37:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:37:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:37:41 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-03-21 23:37:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-21 23:38:09 [DEBUG   ] Got command BAM from MCS: ref #96884
2019-03-21 23:38:09 [INFO    ] Finished processing BAM request
2019-03-21 23:38:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96884   8 58563 85089023 A  ERROR'
2019-03-21 23:38:09 [DEBUG   ] Got command BAM from MCS: ref #96885
2019-03-21 23:38:09 [INFO    ] Finished processing BAM request
2019-03-21 23:38:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96885   8 58563 85089027 A  ERROR'
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:38:09 [DEBUG   ] spawn_process: at 2019-03-21 23:38:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:38:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-21 23:38:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 23:38:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:38:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:38:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:38:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:38:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:38:41 [DEBUG   ] Finished updating board flags in 0.990 seconds
2019-03-21 23:38:51 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-03-21 23:39:09 [DEBUG   ] Got command BAM from MCS: ref #96892
2019-03-21 23:39:09 [INFO    ] Finished processing BAM request
2019-03-21 23:39:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:39:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96892   8 58563 85149031 A  ERROR'
2019-03-21 23:39:09 [DEBUG   ] Got command BAM from MCS: ref #96893
2019-03-21 23:39:09 [INFO    ] Finished processing BAM request
2019-03-21 23:39:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:39:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96893   8 58563 85149035 A  ERROR'
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 23:39:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 23:39:09 [DEBUG   ] spawn_process: at 2019-03-21 23:39:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 23:39:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 23:39:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 23:39:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:39:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:39:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:39:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:39:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:39:41 [DEBUG   ] Finished updating board flags in 1.279 seconds
2019-03-21 23:39:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 23:40:09 [DEBUG   ] Got command BAM from MCS: ref #96894
2019-03-21 23:40:09 [INFO    ] Finished processing BAM request
2019-03-21 23:40:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96894   8 58563 85209031 A  ERROR'
2019-03-21 23:40:09 [DEBUG   ] Got command BAM from MCS: ref #96895
2019-03-21 23:40:09 [INFO    ] Finished processing BAM request
2019-03-21 23:40:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96895   8 58563 85209035 A  ERROR'
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:40:09 [DEBUG   ] spawn_process: at 2019-03-21 23:40:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:40:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-21 23:40:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 23:40:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:40:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:40:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:40:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:40:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:40:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:40:42 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-03-21 23:40:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 23:41:09 [DEBUG   ] Got command BAM from MCS: ref #96897
2019-03-21 23:41:09 [INFO    ] Finished processing BAM request
2019-03-21 23:41:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96897   8 58563 85269027 A  ERROR'
2019-03-21 23:41:09 [DEBUG   ] Got command BAM from MCS: ref #96896
2019-03-21 23:41:09 [INFO    ] Finished processing BAM request
2019-03-21 23:41:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:41:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96896   8 58563 85269031 A  ERROR'
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:41:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:41:09 [DEBUG   ] spawn_process: at 2019-03-21 23:41:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:41:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:41:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:41:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:41:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:41:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:41:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:41:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:41:41 [WARNING ] (13, 1, 'bot')
2019-03-21 23:41:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:41:41 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-03-21 23:41:49 [DEBUG   ] Got command RPT from MCS: ref #96898
2019-03-21 23:41:49 [DEBUG   ] summary = ERROR
2019-03-21 23:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96898  13 58563 85309051 A  ERRORERROR'
2019-03-21 23:41:49 [DEBUG   ] Got command RPT from MCS: ref #96899
2019-03-21 23:41:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96899  77 58563 85309243 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:41:49 [DEBUG   ] Got command RPT from MCS: ref #96900
2019-03-21 23:41:49 [DEBUG   ] summary = ERROR
2019-03-21 23:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96900  13 58563 85309447 A  ERRORERROR'
2019-03-21 23:41:49 [DEBUG   ] Got command RPT from MCS: ref #96901
2019-03-21 23:41:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96901  77 58563 85309651 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:41:49 [DEBUG   ] Got command RPT from MCS: ref #96902
2019-03-21 23:41:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96902  12 58563 85309843 A  ERRORBœ™š'
2019-03-21 23:41:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:42:09 [DEBUG   ] Got command BAM from MCS: ref #96909
2019-03-21 23:42:09 [INFO    ] Finished processing BAM request
2019-03-21 23:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96909   8 58563 85329023 A  ERROR'
2019-03-21 23:42:09 [DEBUG   ] Got command BAM from MCS: ref #96910
2019-03-21 23:42:09 [INFO    ] Finished processing BAM request
2019-03-21 23:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96910   8 58563 85329027 A  ERROR'
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:42:09 [DEBUG   ] spawn_process: at 2019-03-21 23:42:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:42:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:42:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:42:40 [DEBUG   ] Got command RPT from MCS: ref #96911
2019-03-21 23:42:40 [DEBUG   ] summary = ERROR
2019-03-21 23:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96911  13 58563 85360903 A  ERRORERROR'
2019-03-21 23:42:40 [DEBUG   ] Got command RPT from MCS: ref #96912
2019-03-21 23:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96912  77 58563 85360904 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:42:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:42:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:42:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:42:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:42:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:42:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:42:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:42:42 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-03-21 23:42:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:43:09 [DEBUG   ] Got command BAM from MCS: ref #96928
2019-03-21 23:43:09 [INFO    ] Finished processing BAM request
2019-03-21 23:43:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:43:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96928   8 58563 85389027 A  ERROR'
2019-03-21 23:43:09 [DEBUG   ] Got command BAM from MCS: ref #96929
2019-03-21 23:43:09 [INFO    ] Finished processing BAM request
2019-03-21 23:43:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:43:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96929   8 58563 85389031 A  ERROR'
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:43:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:43:09 [DEBUG   ] spawn_process: at 2019-03-21 23:43:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:43:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:43:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:43:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 23:43:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:43:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:43:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:43:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:43:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:43:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:43:42 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-03-21 23:43:51 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-21 23:44:09 [DEBUG   ] Got command BAM from MCS: ref #96930
2019-03-21 23:44:09 [INFO    ] Finished processing BAM request
2019-03-21 23:44:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96930   8 58563 85449023 A  ERROR'
2019-03-21 23:44:09 [DEBUG   ] Got command BAM from MCS: ref #96931
2019-03-21 23:44:09 [INFO    ] Finished processing BAM request
2019-03-21 23:44:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:44:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96931   8 58563 85449027 A  ERROR'
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:44:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:44:09 [DEBUG   ] spawn_process: at 2019-03-21 23:44:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:44:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:44:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:44:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 23:44:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:44:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:44:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:44:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:44:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:44:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:44:42 [DEBUG   ] Finished updating board flags in 1.360 seconds
2019-03-21 23:44:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:45:09 [DEBUG   ] Got command BAM from MCS: ref #96939
2019-03-21 23:45:09 [INFO    ] Finished processing BAM request
2019-03-21 23:45:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96939   8 58563 85509031 A  ERROR'
2019-03-21 23:45:09 [DEBUG   ] Got command BAM from MCS: ref #96938
2019-03-21 23:45:09 [INFO    ] Finished processing BAM request
2019-03-21 23:45:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96938   8 58563 85509035 A  ERROR'
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:45:09 [DEBUG   ] spawn_process: at 2019-03-21 23:45:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:45:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:45:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:45:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-21 23:45:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:45:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-03-21 23:45:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:45:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:45:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:45:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:45:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:45:42 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-03-21 23:45:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:46:09 [DEBUG   ] Got command BAM from MCS: ref #96941
2019-03-21 23:46:09 [INFO    ] Finished processing BAM request
2019-03-21 23:46:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96941   8 58563 85569023 A  ERROR'
2019-03-21 23:46:09 [DEBUG   ] Got command BAM from MCS: ref #96940
2019-03-21 23:46:09 [INFO    ] Finished processing BAM request
2019-03-21 23:46:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:46:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96940   8 58563 85569027 A  ERROR'
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:46:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:46:09 [DEBUG   ] spawn_process: at 2019-03-21 23:46:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:46:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:46:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:46:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:46:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:46:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:46:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:46:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:46:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:46:42 [DEBUG   ] Finished updating board flags in 1.258 seconds
2019-03-21 23:46:49 [DEBUG   ] Got command RPT from MCS: ref #96944
2019-03-21 23:46:49 [DEBUG   ] summary = ERROR
2019-03-21 23:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96944  13 58563 85609131 A  ERRORERROR'
2019-03-21 23:46:49 [DEBUG   ] Got command RPT from MCS: ref #96945
2019-03-21 23:46:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96945  77 58563 85609335 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:46:49 [DEBUG   ] Got command RPT from MCS: ref #96946
2019-03-21 23:46:49 [DEBUG   ] summary = ERROR
2019-03-21 23:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96946  13 58563 85609527 A  ERRORERROR'
2019-03-21 23:46:49 [DEBUG   ] Got command RPT from MCS: ref #96948
2019-03-21 23:46:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96948  77 58563 85609731 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:46:49 [DEBUG   ] Got command RPT from MCS: ref #96949
2019-03-21 23:46:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96949  12 58563 85609935 A  ERRORBœ™š'
2019-03-21 23:46:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:47:09 [DEBUG   ] Got command BAM from MCS: ref #96955
2019-03-21 23:47:09 [INFO    ] Finished processing BAM request
2019-03-21 23:47:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96955   8 58563 85629023 A  ERROR'
2019-03-21 23:47:09 [DEBUG   ] Got command BAM from MCS: ref #96954
2019-03-21 23:47:09 [INFO    ] Finished processing BAM request
2019-03-21 23:47:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:47:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96954   8 58563 85629027 A  ERROR'
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 23:47:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 23:47:09 [DEBUG   ] spawn_process: at 2019-03-21 23:47:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 23:47:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:47:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:47:40 [DEBUG   ] Got command RPT from MCS: ref #96956
2019-03-21 23:47:40 [DEBUG   ] summary = ERROR
2019-03-21 23:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96956  13 58563 85660899 A  ERRORERROR'
2019-03-21 23:47:40 [DEBUG   ] Got command RPT from MCS: ref #96957
2019-03-21 23:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96957  77 58563 85660899 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:47:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:47:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:47:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:47:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:47:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:47:42 [DEBUG   ] Finished updating board flags in 1.157 seconds
2019-03-21 23:47:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:48:09 [DEBUG   ] Got command BAM from MCS: ref #96980
2019-03-21 23:48:09 [INFO    ] Finished processing BAM request
2019-03-21 23:48:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96980   8 58563 85689027 A  ERROR'
2019-03-21 23:48:09 [DEBUG   ] Got command BAM from MCS: ref #96979
2019-03-21 23:48:09 [INFO    ] Finished processing BAM request
2019-03-21 23:48:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96979   8 58563 85689031 A  ERROR'
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:48:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:48:09 [DEBUG   ] spawn_process: at 2019-03-21 23:48:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:48:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:48:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 23:48:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:48:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 23:48:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:48:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:48:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:48:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:48:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:48:42 [DEBUG   ] Finished updating board flags in 1.000 seconds
2019-03-21 23:48:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-21 23:49:09 [DEBUG   ] Got command BAM from MCS: ref #96982
2019-03-21 23:49:09 [INFO    ] Finished processing BAM request
2019-03-21 23:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96982   8 58563 85749027 A  ERROR'
2019-03-21 23:49:09 [DEBUG   ] Got command BAM from MCS: ref #96981
2019-03-21 23:49:09 [INFO    ] Finished processing BAM request
2019-03-21 23:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96981   8 58563 85749031 A  ERROR'
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:49:09 [DEBUG   ] spawn_process: at 2019-03-21 23:49:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:49:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-21 23:49:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 23:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:49:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:49:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:49:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:49:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:49:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:49:42 [DEBUG   ] Finished updating board flags in 0.992 seconds
2019-03-21 23:49:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 23:50:09 [DEBUG   ] Got command BAM from MCS: ref #96983
2019-03-21 23:50:09 [INFO    ] Finished processing BAM request
2019-03-21 23:50:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96983   8 58563 85809027 A  ERROR'
2019-03-21 23:50:09 [DEBUG   ] Got command BAM from MCS: ref #96984
2019-03-21 23:50:09 [INFO    ] Finished processing BAM request
2019-03-21 23:50:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96984   8 58563 85809031 A  ERROR'
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 23:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 23:50:09 [DEBUG   ] spawn_process: at 2019-03-21 23:50:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 23:50:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-21 23:50:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-21 23:50:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:50:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 23:50:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:50:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:50:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:50:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:50:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:50:42 [DEBUG   ] Finished updating board flags in 1.263 seconds
2019-03-21 23:50:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-21 23:51:09 [DEBUG   ] Got command BAM from MCS: ref #96992
2019-03-21 23:51:09 [INFO    ] Finished processing BAM request
2019-03-21 23:51:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96992   8 58563 85869031 A  ERROR'
2019-03-21 23:51:09 [DEBUG   ] Got command BAM from MCS: ref #96991
2019-03-21 23:51:09 [INFO    ] Finished processing BAM request
2019-03-21 23:51:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96991   8 58563 85869035 A  ERROR'
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-21 23:51:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-21 23:51:09 [DEBUG   ] spawn_process: at 2019-03-21 23:51:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-21 23:51:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 23:51:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:51:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:51:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:51:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:51:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:51:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:51:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:51:42 [DEBUG   ] Finished updating board flags in 1.185 seconds
2019-03-21 23:51:49 [DEBUG   ] Got command RPT from MCS: ref #96993
2019-03-21 23:51:49 [DEBUG   ] summary = ERROR
2019-03-21 23:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96993  13 58563 85909215 A  ERRORERROR'
2019-03-21 23:51:49 [DEBUG   ] Got command RPT from MCS: ref #96994
2019-03-21 23:51:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96994  77 58563 85909419 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:51:49 [DEBUG   ] Got command RPT from MCS: ref #96995
2019-03-21 23:51:49 [DEBUG   ] summary = ERROR
2019-03-21 23:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96995  13 58563 85909611 A  ERRORERROR'
2019-03-21 23:51:49 [DEBUG   ] Got command RPT from MCS: ref #96996
2019-03-21 23:51:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96996  77 58563 85909815 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:51:50 [DEBUG   ] Got command RPT from MCS: ref #96997
2019-03-21 23:51:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    96997  12 58563 85910019 A  ERRORB�ff'
2019-03-21 23:51:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:52:09 [DEBUG   ] Got command BAM from MCS: ref #96998
2019-03-21 23:52:09 [INFO    ] Finished processing BAM request
2019-03-21 23:52:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96998   8 58563 85929031 A  ERROR'
2019-03-21 23:52:09 [DEBUG   ] Got command BAM from MCS: ref #96999
2019-03-21 23:52:09 [INFO    ] Finished processing BAM request
2019-03-21 23:52:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    96999   8 58563 85929035 A  ERROR'
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:52:09 [DEBUG   ] spawn_process: at 2019-03-21 23:52:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:52:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:52:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:52:40 [DEBUG   ] Got command RPT from MCS: ref #97000
2019-03-21 23:52:40 [DEBUG   ] summary = ERROR
2019-03-21 23:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97000  13 58563 85960907 A  ERRORERROR'
2019-03-21 23:52:40 [DEBUG   ] Got command RPT from MCS: ref #97001
2019-03-21 23:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97001  77 58563 85960907 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:52:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:52:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:52:42 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 23:52:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:52:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:52:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:52:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:52:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:52:42 [DEBUG   ] Finished updating board flags in 1.037 seconds
2019-03-21 23:52:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:53:09 [DEBUG   ] Got command BAM from MCS: ref #97017
2019-03-21 23:53:09 [INFO    ] Finished processing BAM request
2019-03-21 23:53:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97017   8 58563 85989023 A  ERROR'
2019-03-21 23:53:09 [DEBUG   ] Got command BAM from MCS: ref #97018
2019-03-21 23:53:09 [INFO    ] Finished processing BAM request
2019-03-21 23:53:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97018   8 58563 85989027 A  ERROR'
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-21 23:53:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-21 23:53:09 [DEBUG   ] spawn_process: at 2019-03-21 23:53:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-21 23:53:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:53:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:53:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:53:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:53:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:53:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:53:42 [WARNING ] (13, 1, 'bot')
2019-03-21 23:53:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:53:42 [DEBUG   ] Finished updating board flags in 0.960 seconds
2019-03-21 23:53:52 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:54:09 [DEBUG   ] Got command BAM from MCS: ref #97025
2019-03-21 23:54:09 [INFO    ] Finished processing BAM request
2019-03-21 23:54:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:54:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97025   8 58563 86049027 A  ERROR'
2019-03-21 23:54:09 [DEBUG   ] Got command BAM from MCS: ref #97026
2019-03-21 23:54:09 [INFO    ] Finished processing BAM request
2019-03-21 23:54:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:54:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97026   8 58563 86049031 A  ERROR'
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:54:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:54:09 [DEBUG   ] spawn_process: at 2019-03-21 23:54:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:54:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-21 23:54:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-21 23:54:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:54:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:54:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:54:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:54:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:54:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:54:43 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-03-21 23:54:52 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-21 23:55:09 [DEBUG   ] Got command BAM from MCS: ref #97028
2019-03-21 23:55:09 [INFO    ] Finished processing BAM request
2019-03-21 23:55:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97028   8 58563 86109027 A  ERROR'
2019-03-21 23:55:09 [DEBUG   ] Got command BAM from MCS: ref #97027
2019-03-21 23:55:09 [INFO    ] Finished processing BAM request
2019-03-21 23:55:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97027   8 58563 86109031 A  ERROR'
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:55:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:55:09 [DEBUG   ] spawn_process: at 2019-03-21 23:55:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:55:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:55:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:55:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:55:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-21 23:55:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:55:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:55:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:55:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:55:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:55:43 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-03-21 23:55:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:56:09 [DEBUG   ] Got command BAM from MCS: ref #97029
2019-03-21 23:56:09 [INFO    ] Finished processing BAM request
2019-03-21 23:56:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97029   8 58563 86169027 A  ERROR'
2019-03-21 23:56:09 [DEBUG   ] Got command BAM from MCS: ref #97030
2019-03-21 23:56:09 [INFO    ] Finished processing BAM request
2019-03-21 23:56:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97030   8 58563 86169031 A  ERROR'
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-21 23:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-21 23:56:09 [DEBUG   ] spawn_process: at 2019-03-21 23:56:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-21 23:56:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 23:56:33 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-21 23:56:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:56:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:56:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:56:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:56:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:56:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:56:43 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-03-21 23:56:49 [DEBUG   ] Got command RPT from MCS: ref #97033
2019-03-21 23:56:49 [DEBUG   ] summary = ERROR
2019-03-21 23:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97033  13 58563 86209299 A  ERRORERROR'
2019-03-21 23:56:49 [DEBUG   ] Got command RPT from MCS: ref #97034
2019-03-21 23:56:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97034  77 58563 86209503 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:56:49 [DEBUG   ] Got command RPT from MCS: ref #97035
2019-03-21 23:56:49 [DEBUG   ] summary = ERROR
2019-03-21 23:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97035  13 58563 86209707 A  ERRORERROR'
2019-03-21 23:56:49 [DEBUG   ] Got command RPT from MCS: ref #97037
2019-03-21 23:56:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97037  77 58563 86209899 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:56:50 [DEBUG   ] Got command RPT from MCS: ref #97039
2019-03-21 23:56:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-21 23:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97039  12 58563 86210103 A  ERRORB›™š'
2019-03-21 23:56:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 23:57:09 [DEBUG   ] Got command BAM from MCS: ref #97049
2019-03-21 23:57:09 [INFO    ] Finished processing BAM request
2019-03-21 23:57:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97049   8 58563 86229027 A  ERROR'
2019-03-21 23:57:09 [DEBUG   ] Got command BAM from MCS: ref #97050
2019-03-21 23:57:09 [INFO    ] Finished processing BAM request
2019-03-21 23:57:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:57:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97050   8 58563 86229031 A  ERROR'
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:57:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:57:09 [DEBUG   ] spawn_process: at 2019-03-21 23:57:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:57:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-21 23:57:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-21 23:57:40 [DEBUG   ] Got command RPT from MCS: ref #97051
2019-03-21 23:57:40 [DEBUG   ] summary = ERROR
2019-03-21 23:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97051  13 58563 86260903 A  ERRORERROR'
2019-03-21 23:57:40 [DEBUG   ] Got command RPT from MCS: ref #97052
2019-03-21 23:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-21 23:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97052  77 58563 86260903 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-21 23:57:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:57:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-21 23:57:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:57:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:57:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:57:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:57:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:57:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:57:43 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-03-21 23:57:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-21 23:58:09 [DEBUG   ] Got command BAM from MCS: ref #97068
2019-03-21 23:58:09 [INFO    ] Finished processing BAM request
2019-03-21 23:58:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97068   8 58563 86289027 A  ERROR'
2019-03-21 23:58:09 [DEBUG   ] Got command BAM from MCS: ref #97069
2019-03-21 23:58:09 [INFO    ] Finished processing BAM request
2019-03-21 23:58:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97069   8 58563 86289031 A  ERROR'
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-21 23:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-21 23:58:09 [DEBUG   ] spawn_process: at 2019-03-21 23:58:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-21 23:58:13 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2019-03-21 23:58:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:58:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:58:43 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-21 23:58:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:58:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:58:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:58:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:58:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:58:43 [DEBUG   ] Finished updating board flags in 0.984 seconds
2019-03-21 23:58:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-21 23:59:09 [DEBUG   ] Got command BAM from MCS: ref #97071
2019-03-21 23:59:09 [INFO    ] Finished processing BAM request
2019-03-21 23:59:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:59:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97071   8 58563 86349027 A  ERROR'
2019-03-21 23:59:09 [DEBUG   ] Got command BAM from MCS: ref #97070
2019-03-21 23:59:09 [INFO    ] Finished processing BAM request
2019-03-21 23:59:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-21 23:59:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97070   8 58563 86349031 A  ERROR'
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-21 23:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-21 23:59:09 [DEBUG   ] spawn_process: at 2019-03-21 23:59:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-21 23:59:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-21 23:59:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-21 23:59:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-21 23:59:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-21 23:59:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:59:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:59:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:59:43 [WARNING ] (13, 1, 'bot')
2019-03-21 23:59:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-21 23:59:43 [DEBUG   ] Finished updating board flags in 1.270 seconds
2019-03-21 23:59:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 00:00:09 [DEBUG   ] Got command BAM from MCS: ref #97079
2019-03-22 00:00:09 [INFO    ] Finished processing BAM request
2019-03-22 00:00:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97079   8 58564     9027 A  ERROR'
2019-03-22 00:00:09 [DEBUG   ] Got command BAM from MCS: ref #97078
2019-03-22 00:00:09 [INFO    ] Finished processing BAM request
2019-03-22 00:00:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97078   8 58564     9031 A  ERROR'
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 00:00:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 00:00:09 [DEBUG   ] spawn_process: at 2019-03-22 00:00:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 00:00:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 00:00:34 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-03-22 00:00:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:00:43 [WARNING ] (13, 1, 'bot')
2019-03-22 00:00:43 [WARNING ] (13, 1, 'bot')
2019-03-22 00:00:43 [WARNING ] (13, 1, 'bot')
2019-03-22 00:00:43 [WARNING ] (13, 1, 'bot')
2019-03-22 00:00:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:00:43 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-03-22 00:00:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 00:01:09 [DEBUG   ] Got command BAM from MCS: ref #97081
2019-03-22 00:01:09 [INFO    ] Finished processing BAM request
2019-03-22 00:01:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97081   8 58564    69031 A  ERROR'
2019-03-22 00:01:09 [DEBUG   ] Got command BAM from MCS: ref #97080
2019-03-22 00:01:09 [INFO    ] Finished processing BAM request
2019-03-22 00:01:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97080   8 58564    69035 A  ERROR'
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 00:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 00:01:09 [DEBUG   ] spawn_process: at 2019-03-22 00:01:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 00:01:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:01:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 00:01:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:01:43 [WARNING ] (13, 1, 'bot')
2019-03-22 00:01:43 [WARNING ] (13, 1, 'bot')
2019-03-22 00:01:43 [WARNING ] (13, 1, 'bot')
2019-03-22 00:01:43 [WARNING ] (13, 1, 'bot')
2019-03-22 00:01:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:01:43 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-03-22 00:01:49 [DEBUG   ] Got command RPT from MCS: ref #97082
2019-03-22 00:01:49 [DEBUG   ] summary = ERROR
2019-03-22 00:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97082  13 58564   109383 A  ERRORERROR'
2019-03-22 00:01:49 [DEBUG   ] Got command RPT from MCS: ref #97083
2019-03-22 00:01:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97083  77 58564   109587 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:01:49 [DEBUG   ] Got command RPT from MCS: ref #97084
2019-03-22 00:01:49 [DEBUG   ] summary = ERROR
2019-03-22 00:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97084  13 58564   109791 A  ERRORERROR'
2019-03-22 00:01:49 [DEBUG   ] Got command RPT from MCS: ref #97085
2019-03-22 00:01:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97085  77 58564   109995 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:01:50 [DEBUG   ] Got command RPT from MCS: ref #97086
2019-03-22 00:01:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97086  12 58564   110187 A  ERRORBœ™š'
2019-03-22 00:01:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 00:02:08 [DEBUG   ] Got command BAM from MCS: ref #97087
2019-03-22 00:02:08 [INFO    ] Finished processing BAM request
2019-03-22 00:02:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:02:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97087   8 58564   128023 A  ERROR'
2019-03-22 00:02:08 [DEBUG   ] Got command BAM from MCS: ref #97088
2019-03-22 00:02:08 [INFO    ] Finished processing BAM request
2019-03-22 00:02:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:02:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97088   8 58564   128027 A  ERROR'
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 00:02:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 00:02:08 [DEBUG   ] spawn_process: at 2019-03-22 00:02:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 00:02:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 00:02:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 00:02:40 [DEBUG   ] Got command RPT from MCS: ref #97089
2019-03-22 00:02:40 [DEBUG   ] summary = ERROR
2019-03-22 00:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97089  13 58564   160899 A  ERRORERROR'
2019-03-22 00:02:40 [DEBUG   ] Got command RPT from MCS: ref #97090
2019-03-22 00:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97090  77 58564   160899 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:02:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 00:02:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:02:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 00:02:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:02:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:02:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:02:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:02:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:02:44 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-03-22 00:02:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 00:03:07 [DEBUG   ] Got command BAM from MCS: ref #97113
2019-03-22 00:03:07 [INFO    ] Finished processing BAM request
2019-03-22 00:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97113   8 58564   187035 A  ERROR'
2019-03-22 00:03:07 [DEBUG   ] Got command BAM from MCS: ref #97112
2019-03-22 00:03:07 [INFO    ] Finished processing BAM request
2019-03-22 00:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97112   8 58564   187039 A  ERROR'
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 00:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 00:03:07 [DEBUG   ] spawn_process: at 2019-03-22 00:03:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 00:03:14 [DEBUG   ] Finished updating ant stats in 0.392 seconds
2019-03-22 00:03:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 00:03:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:03:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:03:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:03:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:03:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:03:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:03:44 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-03-22 00:03:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 00:04:06 [DEBUG   ] Got command BAM from MCS: ref #97115
2019-03-22 00:04:06 [INFO    ] Finished processing BAM request
2019-03-22 00:04:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97115   8 58564   246023 A  ERROR'
2019-03-22 00:04:06 [DEBUG   ] Got command BAM from MCS: ref #97114
2019-03-22 00:04:06 [INFO    ] Finished processing BAM request
2019-03-22 00:04:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 00:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    97114   8 58564   246027 A  ERROR'
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 00:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 00:04:06 [DEBUG   ] spawn_process: at 2019-03-22 00:04:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 00:04:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 00:04:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 00:04:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 00:04:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:04:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 00:04:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:04:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:04:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:04:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:04:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:04:44 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-03-22 00:04:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 00:05:00 [DEBUG   ] Got command STP from MCS: ref #97116
2019-03-22 00:05:00 [INFO    ] Finished processing BAM request
2019-03-22 00:05:00 [INFO    ] Shutdown the adder chain on beam #4
2019-03-22 00:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    97116   8 58564   300031 A  ERROR'
2019-03-22 00:05:00 [DEBUG   ] Got command STP from MCS: ref #97117
2019-03-22 00:05:00 [INFO    ] Finished processing BAM request
2019-03-22 00:05:00 [INFO    ] Shutdown the adder chain on beam #2
2019-03-22 00:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    97117   8 58564   300035 A  ERROR'
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 00:05:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 00:05:00 [DEBUG   ] spawn_process: at 2019-03-22 00:05:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 00:05:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 00:05:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 00:05:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:05:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:05:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:05:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:05:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:05:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:05:44 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-03-22 00:05:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 00:06:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 00:06:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 00:06:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:06:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:06:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:06:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:06:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:06:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:06:44 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-03-22 00:06:49 [DEBUG   ] Got command RPT from MCS: ref #97126
2019-03-22 00:06:49 [DEBUG   ] summary = ERROR
2019-03-22 00:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97126  13 58564   409475 A  ERRORERROR'
2019-03-22 00:06:49 [DEBUG   ] Got command RPT from MCS: ref #97127
2019-03-22 00:06:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97127  77 58564   409667 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:06:49 [DEBUG   ] Got command RPT from MCS: ref #97128
2019-03-22 00:06:49 [DEBUG   ] summary = ERROR
2019-03-22 00:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97128  13 58564   409871 A  ERRORERROR'
2019-03-22 00:06:50 [DEBUG   ] Got command RPT from MCS: ref #97130
2019-03-22 00:06:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97130  77 58564   410075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:06:50 [DEBUG   ] Got command RPT from MCS: ref #97131
2019-03-22 00:06:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97131  12 58564   410279 A  ERRORB•™š'
2019-03-22 00:06:55 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2019-03-22 00:07:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 00:07:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 00:07:40 [DEBUG   ] Got command RPT from MCS: ref #97136
2019-03-22 00:07:40 [DEBUG   ] summary = ERROR
2019-03-22 00:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97136  13 58564   460907 A  ERRORERROR'
2019-03-22 00:07:40 [DEBUG   ] Got command RPT from MCS: ref #97137
2019-03-22 00:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97137  77 58564   460907 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:07:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:07:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:07:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:07:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:07:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:07:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:07:44 [DEBUG   ] Finished updating board flags in 0.986 seconds
2019-03-22 00:07:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 00:08:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 00:08:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-22 00:08:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:08:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:08:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:08:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:08:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:08:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:08:45 [DEBUG   ] Finished updating board flags in 1.837 seconds
2019-03-22 00:08:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 00:09:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 00:09:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 00:09:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:09:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:09:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:09:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:09:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:09:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:09:44 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-03-22 00:09:55 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-03-22 00:10:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 00:10:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:10:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:10:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:10:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:10:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:10:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:10:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:10:44 [DEBUG   ] Finished updating board flags in 1.223 seconds
2019-03-22 00:10:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:11:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:11:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:11:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:11:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:11:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:11:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:11:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:11:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:11:44 [DEBUG   ] Finished updating board flags in 1.212 seconds
2019-03-22 00:11:49 [DEBUG   ] Got command RPT from MCS: ref #97206
2019-03-22 00:11:49 [DEBUG   ] summary = ERROR
2019-03-22 00:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97206  13 58564   709559 A  ERRORERROR'
2019-03-22 00:11:49 [DEBUG   ] Got command RPT from MCS: ref #97207
2019-03-22 00:11:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97207  77 58564   709763 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:11:49 [DEBUG   ] Got command RPT from MCS: ref #97208
2019-03-22 00:11:49 [DEBUG   ] summary = ERROR
2019-03-22 00:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97208  13 58564   709955 A  ERRORERROR'
2019-03-22 00:11:50 [DEBUG   ] Got command RPT from MCS: ref #97209
2019-03-22 00:11:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97209  77 58564   710159 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:11:50 [DEBUG   ] Got command RPT from MCS: ref #97210
2019-03-22 00:11:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97210  12 58564   710363 A  ERRORB”™š'
2019-03-22 00:11:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:12:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-22 00:12:36 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 00:12:40 [DEBUG   ] Got command RPT from MCS: ref #97217
2019-03-22 00:12:40 [DEBUG   ] summary = ERROR
2019-03-22 00:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97217  13 58564   760903 A  ERRORERROR'
2019-03-22 00:12:40 [DEBUG   ] Got command RPT from MCS: ref #97218
2019-03-22 00:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97218  77 58564   760903 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:12:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:12:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:12:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:12:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:12:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:12:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:12:44 [DEBUG   ] Finished updating board flags in 1.168 seconds
2019-03-22 00:12:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 00:13:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:13:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:13:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:13:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:13:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:13:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:13:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:13:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:13:44 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-03-22 00:13:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:14:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 00:14:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:14:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:14:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:14:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:14:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:14:44 [WARNING ] (13, 1, 'bot')
2019-03-22 00:14:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:14:44 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-03-22 00:14:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:15:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 00:15:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:15:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:15:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:15:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:15:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:15:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:15:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:15:45 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-03-22 00:15:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-22 00:16:17 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 00:16:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 00:16:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:16:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:16:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:16:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:16:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:16:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:16:45 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-03-22 00:16:49 [DEBUG   ] Got command RPT from MCS: ref #97242
2019-03-22 00:16:49 [DEBUG   ] summary = ERROR
2019-03-22 00:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97242  13 58564  1009643 A  ERRORERROR'
2019-03-22 00:16:49 [DEBUG   ] Got command RPT from MCS: ref #97243
2019-03-22 00:16:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97243  77 58564  1009847 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:16:50 [DEBUG   ] Got command RPT from MCS: ref #97244
2019-03-22 00:16:50 [DEBUG   ] summary = ERROR
2019-03-22 00:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97244  13 58564  1010039 A  ERRORERROR'
2019-03-22 00:16:50 [DEBUG   ] Got command RPT from MCS: ref #97246
2019-03-22 00:16:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97246  77 58564  1010243 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:16:50 [DEBUG   ] Got command RPT from MCS: ref #97248
2019-03-22 00:16:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97248  12 58564  1010447 A  ERRORB”™š'
2019-03-22 00:16:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 00:17:18 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-22 00:17:38 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 00:17:40 [DEBUG   ] Got command RPT from MCS: ref #97252
2019-03-22 00:17:40 [DEBUG   ] summary = ERROR
2019-03-22 00:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97252  13 58564  1060911 A  ERRORERROR'
2019-03-22 00:17:40 [DEBUG   ] Got command RPT from MCS: ref #97253
2019-03-22 00:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97253  77 58564  1060911 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:17:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:17:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:17:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:17:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:17:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:17:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:17:45 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-03-22 00:17:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 00:18:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:18:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:18:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:18:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:18:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:18:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:18:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:18:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:18:45 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-03-22 00:18:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:19:18 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 00:19:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:19:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:19:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:19:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:19:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:19:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:19:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:19:45 [DEBUG   ] Finished updating board flags in 0.983 seconds
2019-03-22 00:19:59 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-22 00:20:19 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 00:20:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 00:20:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:20:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:20:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:20:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:20:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:20:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:20:45 [DEBUG   ] Finished updating board flags in 1.280 seconds
2019-03-22 00:20:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:21:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:21:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:21:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:21:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:21:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:21:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:21:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:21:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:21:45 [DEBUG   ] Finished updating board flags in 1.170 seconds
2019-03-22 00:21:49 [DEBUG   ] Got command RPT from MCS: ref #97281
2019-03-22 00:21:49 [DEBUG   ] summary = ERROR
2019-03-22 00:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97281  13 58564  1309727 A  ERRORERROR'
2019-03-22 00:21:49 [DEBUG   ] Got command RPT from MCS: ref #97282
2019-03-22 00:21:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97282  77 58564  1309931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:21:50 [DEBUG   ] Got command RPT from MCS: ref #97283
2019-03-22 00:21:50 [DEBUG   ] summary = ERROR
2019-03-22 00:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97283  13 58564  1310123 A  ERRORERROR'
2019-03-22 00:21:50 [DEBUG   ] Got command RPT from MCS: ref #97284
2019-03-22 00:21:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97284  77 58564  1310327 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:21:50 [DEBUG   ] Got command RPT from MCS: ref #97285
2019-03-22 00:21:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97285  12 58564  1310531 A  ERRORB”™š'
2019-03-22 00:21:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 00:22:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:22:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:22:40 [DEBUG   ] Got command RPT from MCS: ref #97286
2019-03-22 00:22:40 [DEBUG   ] summary = ERROR
2019-03-22 00:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97286  13 58564  1360911 A  ERRORERROR'
2019-03-22 00:22:40 [DEBUG   ] Got command RPT from MCS: ref #97287
2019-03-22 00:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97287  77 58564  1360911 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:22:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:22:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 00:22:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:22:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:22:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:22:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:22:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:22:45 [DEBUG   ] Finished updating board flags in 1.039 seconds
2019-03-22 00:22:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:23:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:23:39 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 00:23:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:23:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:23:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:23:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:23:45 [WARNING ] (13, 1, 'bot')
2019-03-22 00:23:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:23:45 [DEBUG   ] Finished updating board flags in 0.966 seconds
2019-03-22 00:23:59 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 00:24:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:24:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:24:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:24:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 00:24:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:24:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:24:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:24:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:24:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:24:46 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-03-22 00:25:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:25:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:25:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 00:25:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:25:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 00:25:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:25:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:25:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:25:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:25:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:25:46 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-03-22 00:26:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:26:20 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 00:26:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 00:26:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:26:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 00:26:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:26:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:26:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:26:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:26:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:26:46 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-03-22 00:26:49 [DEBUG   ] Got command RPT from MCS: ref #97311
2019-03-22 00:26:49 [DEBUG   ] summary = ERROR
2019-03-22 00:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97311  13 58564  1609811 A  ERRORERROR'
2019-03-22 00:26:50 [DEBUG   ] Got command RPT from MCS: ref #97312
2019-03-22 00:26:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97312  77 58564  1610015 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:26:50 [DEBUG   ] Got command RPT from MCS: ref #97313
2019-03-22 00:26:50 [DEBUG   ] summary = ERROR
2019-03-22 00:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97313  13 58564  1610219 A  ERRORERROR'
2019-03-22 00:26:50 [DEBUG   ] Got command RPT from MCS: ref #97315
2019-03-22 00:26:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97315  77 58564  1610411 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:26:50 [DEBUG   ] Got command RPT from MCS: ref #97316
2019-03-22 00:26:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97316  12 58564  1610615 A  ERRORB”™š'
2019-03-22 00:27:00 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 00:27:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:27:40 [DEBUG   ] Got command RPT from MCS: ref #97327
2019-03-22 00:27:40 [DEBUG   ] summary = ERROR
2019-03-22 00:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97327  13 58564  1660915 A  ERRORERROR'
2019-03-22 00:27:40 [DEBUG   ] Got command RPT from MCS: ref #97328
2019-03-22 00:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97328  77 58564  1660915 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:27:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:27:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:27:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:27:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:27:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:27:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:27:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:27:46 [DEBUG   ] Finished updating board flags in 1.000 seconds
2019-03-22 00:28:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:28:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:28:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:28:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:28:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:28:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:28:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:28:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:28:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:28:46 [DEBUG   ] Finished updating board flags in 1.297 seconds
2019-03-22 00:29:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:29:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:29:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:29:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:29:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 00:29:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:29:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:29:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:29:46 [WARNING ] (13, 1, 'bot')
2019-03-22 00:29:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:29:46 [DEBUG   ] Finished updating board flags in 1.147 seconds
2019-03-22 00:30:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:30:11 [DEBUG   ] Got command TBW from MCS: ref #97351
2019-03-22 00:30:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-03-22 00:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    97351   8 58564  1811207 A  ERROR'
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-03-22 00:30:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-03-22 00:30:13 [DEBUG   ] spawn_process: at 2019-03-22 00:30:13 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-03-22 00:30:13 [INFO    ] Finished spawning TBW
2019-03-22 00:30:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:30:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:30:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:30:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:30:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:30:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:30:47 [DEBUG   ] Finished updating board flags in 1.679 seconds
2019-03-22 00:31:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:31:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:31:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:31:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:31:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:31:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:31:47 [DEBUG   ] Finished updating board flags in 1.646 seconds
2019-03-22 00:31:49 [DEBUG   ] Got command RPT from MCS: ref #97356
2019-03-22 00:31:49 [DEBUG   ] summary = ERROR
2019-03-22 00:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97356  13 58564  1909899 A  ERRORERROR'
2019-03-22 00:31:50 [DEBUG   ] Got command RPT from MCS: ref #97357
2019-03-22 00:31:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97357  77 58564  1910103 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:31:50 [DEBUG   ] Got command RPT from MCS: ref #97358
2019-03-22 00:31:50 [DEBUG   ] summary = ERROR
2019-03-22 00:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97358  13 58564  1910307 A  ERRORERROR'
2019-03-22 00:31:50 [DEBUG   ] Got command RPT from MCS: ref #97359
2019-03-22 00:31:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97359  77 58564  1910499 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:31:50 [DEBUG   ] Got command RPT from MCS: ref #97360
2019-03-22 00:31:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97360  12 58564  1910703 A  ERRORB”™š'
2019-03-22 00:32:01 [INFO    ] __waitForTBW - TBW finished in 108.389 s
2019-03-22 00:32:02 [INFO    ] Started antennas statistics background thread
2019-03-22 00:32:03 [DEBUG   ] Finished updating ant stats in 1.300 seconds
2019-03-22 00:32:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 00:32:40 [DEBUG   ] Got command RPT from MCS: ref #97362
2019-03-22 00:32:40 [DEBUG   ] summary = ERROR
2019-03-22 00:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97362  13 58564  1960915 A  ERRORERROR'
2019-03-22 00:32:40 [DEBUG   ] Got command RPT from MCS: ref #97363
2019-03-22 00:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97363  77 58564  1960915 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:32:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:32:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:32:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:32:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:32:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:32:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:32:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:32:47 [DEBUG   ] Finished updating board flags in 1.443 seconds
2019-03-22 00:33:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 00:33:23 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 00:33:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:33:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:33:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:33:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:33:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:33:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:33:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:33:47 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-03-22 00:34:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 00:34:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 00:34:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 00:34:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:34:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:34:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:34:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:34:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:34:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:34:47 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-03-22 00:35:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:35:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:35:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:35:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:35:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:35:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:35:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:35:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:35:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:35:47 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-03-22 00:36:03 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-22 00:36:23 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 00:36:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 00:36:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:36:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:36:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:36:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:36:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:36:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:36:47 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-03-22 00:36:49 [DEBUG   ] Got command RPT from MCS: ref #97395
2019-03-22 00:36:49 [DEBUG   ] summary = ERROR
2019-03-22 00:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97395  13 58564  2209987 A  ERRORERROR'
2019-03-22 00:36:50 [DEBUG   ] Got command RPT from MCS: ref #97396
2019-03-22 00:36:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:36:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97396  77 58564  2210191 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:36:50 [DEBUG   ] Got command RPT from MCS: ref #97397
2019-03-22 00:36:50 [DEBUG   ] summary = ERROR
2019-03-22 00:36:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97397  13 58564  2210383 A  ERRORERROR'
2019-03-22 00:36:50 [DEBUG   ] Got command RPT from MCS: ref #97399
2019-03-22 00:36:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:36:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97399  77 58564  2210587 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:36:50 [DEBUG   ] Got command RPT from MCS: ref #97400
2019-03-22 00:36:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:36:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97400  12 58564  2210791 A  ERRORB”™š'
2019-03-22 00:37:03 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 00:37:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 00:37:40 [DEBUG   ] Got command RPT from MCS: ref #97405
2019-03-22 00:37:40 [DEBUG   ] summary = ERROR
2019-03-22 00:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97405  13 58564  2260911 A  ERRORERROR'
2019-03-22 00:37:40 [DEBUG   ] Got command RPT from MCS: ref #97406
2019-03-22 00:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97406  77 58564  2260911 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:37:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:37:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:37:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:37:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:37:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:37:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:37:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:37:47 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-03-22 00:38:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:38:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:38:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:38:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:38:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:38:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:38:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:38:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:38:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:38:47 [DEBUG   ] Finished updating board flags in 0.997 seconds
2019-03-22 00:39:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:39:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:39:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:39:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:39:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:39:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:39:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:39:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:39:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:39:47 [DEBUG   ] Finished updating board flags in 1.286 seconds
2019-03-22 00:40:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 00:40:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:40:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:40:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:40:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:40:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:40:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:40:47 [WARNING ] (13, 1, 'bot')
2019-03-22 00:40:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:40:47 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-03-22 00:41:04 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 00:41:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:41:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:41:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:41:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:41:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:41:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:41:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:41:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:41:48 [DEBUG   ] Finished updating board flags in 1.561 seconds
2019-03-22 00:41:50 [DEBUG   ] Got command RPT from MCS: ref #97428
2019-03-22 00:41:50 [DEBUG   ] summary = ERROR
2019-03-22 00:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97428  13 58564  2510079 A  ERRORERROR'
2019-03-22 00:41:50 [DEBUG   ] Got command RPT from MCS: ref #97429
2019-03-22 00:41:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97429  77 58564  2510271 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:41:50 [DEBUG   ] Got command RPT from MCS: ref #97430
2019-03-22 00:41:50 [DEBUG   ] summary = ERROR
2019-03-22 00:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97430  13 58564  2510475 A  ERRORERROR'
2019-03-22 00:41:50 [DEBUG   ] Got command RPT from MCS: ref #97431
2019-03-22 00:41:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97431  77 58564  2510679 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:41:50 [DEBUG   ] Got command RPT from MCS: ref #97432
2019-03-22 00:41:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97432  12 58564  2510883 A  ERRORB“™š'
2019-03-22 00:42:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:42:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:42:40 [DEBUG   ] Got command RPT from MCS: ref #97439
2019-03-22 00:42:40 [DEBUG   ] summary = ERROR
2019-03-22 00:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97439  13 58564  2560911 A  ERRORERROR'
2019-03-22 00:42:40 [DEBUG   ] Got command RPT from MCS: ref #97440
2019-03-22 00:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97440  77 58564  2560911 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:42:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:42:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:42:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 00:42:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:42:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:42:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:42:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:42:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:42:48 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-03-22 00:43:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:43:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:43:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:43:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:43:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:43:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:43:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:43:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:43:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:43:48 [DEBUG   ] Finished updating board flags in 1.276 seconds
2019-03-22 00:44:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:44:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:44:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 00:44:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:44:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:44:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:44:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:44:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:44:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:44:48 [DEBUG   ] Finished updating board flags in 1.127 seconds
2019-03-22 00:45:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:45:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 00:45:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 00:45:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:45:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:45:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:45:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:45:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:45:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:45:48 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-03-22 00:46:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:46:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:46:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:46:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:46:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:46:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:46:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:46:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:46:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:46:48 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-03-22 00:46:50 [DEBUG   ] Got command RPT from MCS: ref #97470
2019-03-22 00:46:50 [DEBUG   ] summary = ERROR
2019-03-22 00:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97470  13 58564  2810163 A  ERRORERROR'
2019-03-22 00:46:50 [DEBUG   ] Got command RPT from MCS: ref #97471
2019-03-22 00:46:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97471  77 58564  2810355 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:46:50 [DEBUG   ] Got command RPT from MCS: ref #97472
2019-03-22 00:46:50 [DEBUG   ] summary = ERROR
2019-03-22 00:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97472  13 58564  2810559 A  ERRORERROR'
2019-03-22 00:46:50 [DEBUG   ] Got command RPT from MCS: ref #97474
2019-03-22 00:46:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97474  77 58564  2810763 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:46:50 [DEBUG   ] Got command RPT from MCS: ref #97476
2019-03-22 00:46:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97476  12 58564  2810967 A  ERRORB“™š'
2019-03-22 00:47:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 00:47:24 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 00:47:40 [DEBUG   ] Got command RPT from MCS: ref #97485
2019-03-22 00:47:40 [DEBUG   ] summary = ERROR
2019-03-22 00:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97485  13 58564  2860911 A  ERRORERROR'
2019-03-22 00:47:40 [DEBUG   ] Got command RPT from MCS: ref #97486
2019-03-22 00:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97486  77 58564  2860911 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:47:44 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 00:47:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:47:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:47:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:47:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:47:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:47:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:47:48 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-03-22 00:48:05 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-22 00:48:25 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 00:48:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:48:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:48:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:48:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:48:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:48:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:48:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:48:48 [DEBUG   ] Finished updating board flags in 1.482 seconds
2019-03-22 00:49:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:49:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:49:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:49:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:49:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:49:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:49:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:49:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:49:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:49:48 [DEBUG   ] Finished updating board flags in 1.342 seconds
2019-03-22 00:50:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:50:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:50:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:50:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:50:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:50:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:50:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:50:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:50:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:50:48 [DEBUG   ] Finished updating board flags in 1.231 seconds
2019-03-22 00:51:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:51:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:51:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:51:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:51:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 00:51:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:51:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:51:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:51:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:51:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:51:49 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-03-22 00:51:50 [DEBUG   ] Got command RPT from MCS: ref #97514
2019-03-22 00:51:50 [DEBUG   ] summary = ERROR
2019-03-22 00:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97514  13 58564  3110243 A  ERRORERROR'
2019-03-22 00:51:50 [DEBUG   ] Got command RPT from MCS: ref #97515
2019-03-22 00:51:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97515  77 58564  3110447 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:51:50 [DEBUG   ] Got command RPT from MCS: ref #97516
2019-03-22 00:51:50 [DEBUG   ] summary = ERROR
2019-03-22 00:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97516  13 58564  3110651 A  ERRORERROR'
2019-03-22 00:51:50 [DEBUG   ] Got command RPT from MCS: ref #97517
2019-03-22 00:51:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97517  77 58564  3110843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:51:51 [DEBUG   ] Got command RPT from MCS: ref #97518
2019-03-22 00:51:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97518  12 58564  3111047 A  ERRORB“™š'
2019-03-22 00:52:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:52:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:52:40 [DEBUG   ] Got command RPT from MCS: ref #97519
2019-03-22 00:52:40 [DEBUG   ] summary = ERROR
2019-03-22 00:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97519  13 58564  3160919 A  ERRORERROR'
2019-03-22 00:52:40 [DEBUG   ] Got command RPT from MCS: ref #97520
2019-03-22 00:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97520  77 58564  3160919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:52:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:52:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:52:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 00:52:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:52:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:52:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:52:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:52:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:52:49 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-03-22 00:53:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:53:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:53:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:53:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:53:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:53:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:53:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:53:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:53:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:53:48 [DEBUG   ] Finished updating board flags in 1.044 seconds
2019-03-22 00:54:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:54:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:54:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:54:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:54:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:54:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:54:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:54:48 [WARNING ] (13, 1, 'bot')
2019-03-22 00:54:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:54:48 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-03-22 00:55:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 00:55:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:55:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 00:55:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:55:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:55:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:55:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:55:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:55:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:55:49 [DEBUG   ] Finished updating board flags in 1.335 seconds
2019-03-22 00:56:05 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2019-03-22 00:56:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 00:56:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 00:56:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:56:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:56:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:56:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:56:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:56:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:56:49 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-03-22 00:56:50 [DEBUG   ] Got command RPT from MCS: ref #97544
2019-03-22 00:56:50 [DEBUG   ] summary = ERROR
2019-03-22 00:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97544  13 58564  3410331 A  ERRORERROR'
2019-03-22 00:56:50 [DEBUG   ] Got command RPT from MCS: ref #97545
2019-03-22 00:56:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97545  77 58564  3410535 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:56:50 [DEBUG   ] Got command RPT from MCS: ref #97546
2019-03-22 00:56:50 [DEBUG   ] summary = ERROR
2019-03-22 00:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97546  13 58564  3410727 A  ERRORERROR'
2019-03-22 00:56:50 [DEBUG   ] Got command RPT from MCS: ref #97548
2019-03-22 00:56:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97548  77 58564  3410931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:56:51 [DEBUG   ] Got command RPT from MCS: ref #97549
2019-03-22 00:56:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 00:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97549  12 58564  3411135 A  ERRORB“™š'
2019-03-22 00:57:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 00:57:26 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-22 00:57:40 [DEBUG   ] Got command RPT from MCS: ref #97560
2019-03-22 00:57:40 [DEBUG   ] summary = ERROR
2019-03-22 00:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97560  13 58564  3460919 A  ERRORERROR'
2019-03-22 00:57:40 [DEBUG   ] Got command RPT from MCS: ref #97561
2019-03-22 00:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 00:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97561  77 58564  3460919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 00:57:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:57:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:57:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:57:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:57:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:57:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:57:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:57:49 [DEBUG   ] Finished updating board flags in 1.175 seconds
2019-03-22 00:58:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:58:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:58:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:58:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:58:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 00:58:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:58:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:58:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:58:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:58:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:58:49 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-03-22 00:59:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:59:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:59:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 00:59:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 00:59:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:59:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:59:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:59:49 [WARNING ] (13, 1, 'bot')
2019-03-22 00:59:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 00:59:49 [DEBUG   ] Finished updating board flags in 0.990 seconds
2019-03-22 01:00:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:00:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:00:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:00:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:00:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:00:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:00:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:00:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:00:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:00:50 [DEBUG   ] Finished updating board flags in 1.858 seconds
2019-03-22 01:01:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:01:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:01:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:01:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:01:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:01:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:01:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:01:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:01:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:01:49 [DEBUG   ] Finished updating board flags in 1.256 seconds
2019-03-22 01:01:50 [DEBUG   ] Got command RPT from MCS: ref #97583
2019-03-22 01:01:50 [DEBUG   ] summary = ERROR
2019-03-22 01:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97583  13 58564  3710419 A  ERRORERROR'
2019-03-22 01:01:50 [DEBUG   ] Got command RPT from MCS: ref #97584
2019-03-22 01:01:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97584  77 58564  3710623 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:01:50 [DEBUG   ] Got command RPT from MCS: ref #97585
2019-03-22 01:01:50 [DEBUG   ] summary = ERROR
2019-03-22 01:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97585  13 58564  3710815 A  ERRORERROR'
2019-03-22 01:01:51 [DEBUG   ] Got command RPT from MCS: ref #97586
2019-03-22 01:01:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97586  77 58564  3711019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:01:51 [DEBUG   ] Got command RPT from MCS: ref #97587
2019-03-22 01:01:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97587  12 58564  3711223 A  ERRORB“™š'
2019-03-22 01:02:06 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 01:02:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:02:40 [DEBUG   ] Got command RPT from MCS: ref #97588
2019-03-22 01:02:40 [DEBUG   ] summary = ERROR
2019-03-22 01:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97588  13 58564  3760915 A  ERRORERROR'
2019-03-22 01:02:40 [DEBUG   ] Got command RPT from MCS: ref #97589
2019-03-22 01:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97589  77 58564  3760915 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:02:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:02:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:02:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:02:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:02:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:02:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:02:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:02:50 [DEBUG   ] Finished updating board flags in 1.736 seconds
2019-03-22 01:03:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:03:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:03:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:03:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:03:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:03:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:03:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:03:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:03:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:03:49 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-03-22 01:04:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:04:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:04:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:04:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:04:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:04:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:04:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:04:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:04:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:04:49 [DEBUG   ] Finished updating board flags in 1.031 seconds
2019-03-22 01:05:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:05:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:05:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:05:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:05:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:05:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:05:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:05:49 [WARNING ] (13, 1, 'bot')
2019-03-22 01:05:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:05:49 [DEBUG   ] Finished updating board flags in 0.964 seconds
2019-03-22 01:06:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:06:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:06:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:06:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:06:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:06:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:06:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:06:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:06:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:06:50 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-03-22 01:06:50 [DEBUG   ] Got command RPT from MCS: ref #97619
2019-03-22 01:06:50 [DEBUG   ] summary = ERROR
2019-03-22 01:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97619  13 58564  4010499 A  ERRORERROR'
2019-03-22 01:06:50 [DEBUG   ] Got command RPT from MCS: ref #97620
2019-03-22 01:06:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97620  77 58564  4010703 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:06:50 [DEBUG   ] Got command RPT from MCS: ref #97621
2019-03-22 01:06:50 [DEBUG   ] summary = ERROR
2019-03-22 01:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97621  13 58564  4010895 A  ERRORERROR'
2019-03-22 01:06:51 [DEBUG   ] Got command RPT from MCS: ref #97623
2019-03-22 01:06:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97623  77 58564  4011099 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:06:51 [DEBUG   ] Got command RPT from MCS: ref #97625
2019-03-22 01:06:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97625  12 58564  4011303 A  ERRORB“™š'
2019-03-22 01:07:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:07:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:07:40 [DEBUG   ] Got command RPT from MCS: ref #97629
2019-03-22 01:07:40 [DEBUG   ] summary = ERROR
2019-03-22 01:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97629  13 58564  4060923 A  ERRORERROR'
2019-03-22 01:07:40 [DEBUG   ] Got command RPT from MCS: ref #97630
2019-03-22 01:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97630  77 58564  4060923 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:07:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:07:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:07:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:07:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:07:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:07:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:07:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:07:50 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-03-22 01:08:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:08:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:08:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:08:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:08:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:08:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:08:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:08:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:08:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:08:50 [DEBUG   ] Finished updating board flags in 1.228 seconds
2019-03-22 01:09:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 01:09:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:09:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:09:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:09:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:09:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:09:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:09:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:09:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:09:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:09:50 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-03-22 01:10:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:10:26 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 01:10:46 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 01:10:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:10:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:10:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:10:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:10:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:10:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:10:50 [DEBUG   ] Finished updating board flags in 0.996 seconds
2019-03-22 01:11:06 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 01:11:26 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 01:11:46 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 01:11:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:11:50 [DEBUG   ] Got command RPT from MCS: ref #97652
2019-03-22 01:11:50 [DEBUG   ] summary = ERROR
2019-03-22 01:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97652  13 58564  4310587 A  ERRORERROR'
2019-03-22 01:11:50 [DEBUG   ] Got command RPT from MCS: ref #97653
2019-03-22 01:11:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97653  77 58564  4310791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:11:50 [DEBUG   ] Got command RPT from MCS: ref #97654
2019-03-22 01:11:50 [DEBUG   ] summary = ERROR
2019-03-22 01:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97654  13 58564  4310983 A  ERRORERROR'
2019-03-22 01:11:51 [DEBUG   ] Got command RPT from MCS: ref #97655
2019-03-22 01:11:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97655  77 58564  4311187 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:11:51 [DEBUG   ] Got command RPT from MCS: ref #97656
2019-03-22 01:11:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97656  12 58564  4311391 A  ERRORB“™š'
2019-03-22 01:11:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:11:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:11:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:11:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:11:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:11:51 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-03-22 01:12:06 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-03-22 01:12:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:12:40 [DEBUG   ] Got command RPT from MCS: ref #97663
2019-03-22 01:12:40 [DEBUG   ] summary = ERROR
2019-03-22 01:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97663  13 58564  4360919 A  ERRORERROR'
2019-03-22 01:12:40 [DEBUG   ] Got command RPT from MCS: ref #97664
2019-03-22 01:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97664  77 58564  4360919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:12:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 01:12:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:12:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 01:12:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:12:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:12:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:12:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:12:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:12:51 [DEBUG   ] Finished updating board flags in 1.772 seconds
2019-03-22 01:13:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:13:27 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-22 01:13:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:13:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:13:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:13:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:13:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:13:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:13:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:13:51 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-03-22 01:14:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:14:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:14:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:14:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:14:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:14:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:14:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:14:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:14:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:14:50 [DEBUG   ] Finished updating board flags in 1.039 seconds
2019-03-22 01:15:07 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 01:15:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:15:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:15:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:15:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:15:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:15:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:15:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:15:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:15:50 [DEBUG   ] Finished updating board flags in 1.031 seconds
2019-03-22 01:16:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:16:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:16:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:16:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:16:50 [DEBUG   ] Got command RPT from MCS: ref #97688
2019-03-22 01:16:50 [DEBUG   ] summary = ERROR
2019-03-22 01:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97688  13 58564  4610667 A  ERRORERROR'
2019-03-22 01:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 01:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:16:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:16:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:16:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:16:50 [WARNING ] (13, 1, 'bot')
2019-03-22 01:16:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:16:50 [DEBUG   ] Finished updating board flags in 0.965 seconds
2019-03-22 01:16:50 [DEBUG   ] Got command RPT from MCS: ref #97689
2019-03-22 01:16:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97689  77 58564  4610871 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:16:51 [DEBUG   ] Got command RPT from MCS: ref #97690
2019-03-22 01:16:51 [DEBUG   ] summary = ERROR
2019-03-22 01:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97690  13 58564  4611067 A  ERRORERROR'
2019-03-22 01:16:51 [DEBUG   ] Got command RPT from MCS: ref #97692
2019-03-22 01:16:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97692  77 58564  4611271 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:16:51 [DEBUG   ] Got command RPT from MCS: ref #97694
2019-03-22 01:16:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97694  12 58564  4611475 A  ERRORB“™š'
2019-03-22 01:17:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:17:27 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 01:17:40 [DEBUG   ] Got command RPT from MCS: ref #97698
2019-03-22 01:17:40 [DEBUG   ] summary = ERROR
2019-03-22 01:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97698  13 58564  4660927 A  ERRORERROR'
2019-03-22 01:17:40 [DEBUG   ] Got command RPT from MCS: ref #97699
2019-03-22 01:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97699  77 58564  4660927 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:17:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:17:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:17:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:17:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:17:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:17:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:17:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:17:51 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-03-22 01:18:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:18:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:18:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:18:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:18:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:18:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:18:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:18:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:18:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:18:51 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-03-22 01:19:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:19:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:19:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:19:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:19:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:19:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:19:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:19:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:19:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:19:51 [DEBUG   ] Finished updating board flags in 1.165 seconds
2019-03-22 01:20:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:20:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:20:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:20:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:20:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:20:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:20:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:20:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:20:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:20:51 [DEBUG   ] Finished updating board flags in 1.057 seconds
2019-03-22 01:21:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:21:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:21:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:21:50 [DEBUG   ] Got command RPT from MCS: ref #97727
2019-03-22 01:21:50 [DEBUG   ] summary = ERROR
2019-03-22 01:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97727  13 58564  4910755 A  ERRORERROR'
2019-03-22 01:21:50 [DEBUG   ] Got command RPT from MCS: ref #97728
2019-03-22 01:21:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97728  77 58564  4910959 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:21:51 [DEBUG   ] Got command RPT from MCS: ref #97729
2019-03-22 01:21:51 [DEBUG   ] summary = ERROR
2019-03-22 01:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97729  13 58564  4911155 A  ERRORERROR'
2019-03-22 01:21:51 [DEBUG   ] Got command RPT from MCS: ref #97730
2019-03-22 01:21:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97730  77 58564  4911359 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:21:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:21:51 [DEBUG   ] Got command RPT from MCS: ref #97731
2019-03-22 01:21:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97731  12 58564  4911567 A  ERRORBˆÌÍ'
2019-03-22 01:21:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:21:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:21:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:21:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:21:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:21:52 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-03-22 01:22:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:22:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:22:40 [DEBUG   ] Got command RPT from MCS: ref #97732
2019-03-22 01:22:40 [DEBUG   ] summary = ERROR
2019-03-22 01:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97732  13 58564  4960923 A  ERRORERROR'
2019-03-22 01:22:40 [DEBUG   ] Got command RPT from MCS: ref #97733
2019-03-22 01:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97733  77 58564  4960923 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:22:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:22:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:22:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:22:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:22:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:22:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:22:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:22:51 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-03-22 01:23:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:23:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:23:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:23:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:23:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:23:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:23:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:23:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:23:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:23:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:23:51 [DEBUG   ] Finished updating board flags in 1.262 seconds
2019-03-22 01:24:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:24:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:24:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:24:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:24:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:24:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:24:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:24:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:24:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:24:51 [DEBUG   ] Finished updating board flags in 1.165 seconds
2019-03-22 01:25:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:25:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:25:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:25:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:25:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:25:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:25:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:25:51 [WARNING ] (13, 1, 'bot')
2019-03-22 01:25:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:25:51 [DEBUG   ] Finished updating board flags in 1.030 seconds
2019-03-22 01:26:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:26:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:26:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:26:50 [DEBUG   ] Got command RPT from MCS: ref #97757
2019-03-22 01:26:50 [DEBUG   ] summary = ERROR
2019-03-22 01:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97757  13 58564  5210847 A  ERRORERROR'
2019-03-22 01:26:51 [DEBUG   ] Got command RPT from MCS: ref #97758
2019-03-22 01:26:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97758  77 58564  5211051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:26:51 [DEBUG   ] Got command RPT from MCS: ref #97759
2019-03-22 01:26:51 [DEBUG   ] summary = ERROR
2019-03-22 01:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97759  13 58564  5211243 A  ERRORERROR'
2019-03-22 01:26:51 [DEBUG   ] Got command RPT from MCS: ref #97761
2019-03-22 01:26:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97761  77 58564  5211447 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:26:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:26:51 [DEBUG   ] Got command RPT from MCS: ref #97762
2019-03-22 01:26:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97762  12 58564  5211655 A  ERRORBˆÌÍ'
2019-03-22 01:26:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:26:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:26:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:26:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:26:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:26:52 [DEBUG   ] Finished updating board flags in 1.548 seconds
2019-03-22 01:27:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:27:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:27:40 [DEBUG   ] Got command RPT from MCS: ref #97773
2019-03-22 01:27:40 [DEBUG   ] summary = ERROR
2019-03-22 01:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97773  13 58564  5260927 A  ERRORERROR'
2019-03-22 01:27:40 [DEBUG   ] Got command RPT from MCS: ref #97774
2019-03-22 01:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97774  77 58564  5260927 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:27:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:27:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:27:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:27:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:27:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:27:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:27:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:27:52 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-03-22 01:28:07 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 01:28:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 01:28:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 01:28:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:28:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:28:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:28:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:28:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:28:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:28:52 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-03-22 01:29:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 01:29:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 01:29:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 01:29:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:29:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:29:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:29:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:29:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:29:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:29:52 [DEBUG   ] Finished updating board flags in 1.252 seconds
2019-03-22 01:30:07 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 01:30:28 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 01:30:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:30:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:30:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:30:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:30:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:30:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:30:52 [DEBUG   ] Finished updating board flags in 1.142 seconds
2019-03-22 01:31:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:31:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:31:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:31:50 [DEBUG   ] Got command RPT from MCS: ref #97796
2019-03-22 01:31:50 [DEBUG   ] summary = ERROR
2019-03-22 01:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97796  13 58564  5510927 A  ERRORERROR'
2019-03-22 01:31:51 [DEBUG   ] Got command RPT from MCS: ref #97797
2019-03-22 01:31:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97797  77 58564  5511131 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:31:51 [DEBUG   ] Got command RPT from MCS: ref #97798
2019-03-22 01:31:51 [DEBUG   ] summary = ERROR
2019-03-22 01:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97798  13 58564  5511335 A  ERRORERROR'
2019-03-22 01:31:51 [DEBUG   ] Got command RPT from MCS: ref #97799
2019-03-22 01:31:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97799  77 58564  5511539 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:31:51 [DEBUG   ] Got command RPT from MCS: ref #97800
2019-03-22 01:31:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97800  12 58564  5511735 A  ERRORB‡ÌÍ'
2019-03-22 01:31:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:31:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:31:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:31:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:31:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:31:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:31:52 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-03-22 01:32:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:32:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:32:40 [DEBUG   ] Got command RPT from MCS: ref #97801
2019-03-22 01:32:40 [DEBUG   ] summary = ERROR
2019-03-22 01:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97801  13 58564  5560931 A  ERRORERROR'
2019-03-22 01:32:40 [DEBUG   ] Got command RPT from MCS: ref #97802
2019-03-22 01:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97802  77 58564  5560931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:32:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:32:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:32:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:32:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:32:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:32:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:32:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:32:52 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-03-22 01:33:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:33:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:33:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:33:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:33:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:33:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:33:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:33:52 [WARNING ] (13, 1, 'bot')
2019-03-22 01:33:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:33:52 [DEBUG   ] Finished updating board flags in 1.300 seconds
2019-03-22 01:34:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:34:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:34:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:34:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:34:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:34:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:34:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:34:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:34:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:34:53 [DEBUG   ] Finished updating board flags in 1.730 seconds
2019-03-22 01:35:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:35:28 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 01:35:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:35:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:35:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:35:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:35:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:35:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:35:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:35:53 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-03-22 01:36:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:36:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:36:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:36:51 [DEBUG   ] Got command RPT from MCS: ref #97832
2019-03-22 01:36:51 [DEBUG   ] summary = ERROR
2019-03-22 01:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97832  13 58564  5811019 A  ERRORERROR'
2019-03-22 01:36:51 [DEBUG   ] Got command RPT from MCS: ref #97833
2019-03-22 01:36:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97833  77 58564  5811223 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:36:51 [DEBUG   ] Got command RPT from MCS: ref #97834
2019-03-22 01:36:51 [DEBUG   ] summary = ERROR
2019-03-22 01:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97834  13 58564  5811415 A  ERRORERROR'
2019-03-22 01:36:51 [DEBUG   ] Got command RPT from MCS: ref #97836
2019-03-22 01:36:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97836  77 58564  5811619 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:36:51 [DEBUG   ] Got command RPT from MCS: ref #97838
2019-03-22 01:36:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97838  12 58564  5811823 A  ERRORB’™š'
2019-03-22 01:36:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:36:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:36:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:36:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:36:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:36:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:36:53 [DEBUG   ] Finished updating board flags in 1.476 seconds
2019-03-22 01:37:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:37:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:37:40 [DEBUG   ] Got command RPT from MCS: ref #97842
2019-03-22 01:37:40 [DEBUG   ] summary = ERROR
2019-03-22 01:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97842  13 58564  5860931 A  ERRORERROR'
2019-03-22 01:37:40 [DEBUG   ] Got command RPT from MCS: ref #97843
2019-03-22 01:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97843  77 58564  5860931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:37:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:37:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 01:37:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:37:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:37:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:37:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:37:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:37:53 [DEBUG   ] Finished updating board flags in 1.337 seconds
2019-03-22 01:38:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:38:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:38:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:38:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:38:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:38:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:38:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:38:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:38:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:38:53 [DEBUG   ] Finished updating board flags in 1.205 seconds
2019-03-22 01:39:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:39:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:39:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:39:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:39:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:39:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:39:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:39:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:39:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:39:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:39:53 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-03-22 01:40:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:40:29 [DEBUG   ] Finished updating ant stats in 1.800 seconds
2019-03-22 01:40:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:40:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:40:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:40:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:40:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:40:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:40:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:40:53 [DEBUG   ] Finished updating board flags in 1.226 seconds
2019-03-22 01:41:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:41:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:41:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:41:51 [DEBUG   ] Got command RPT from MCS: ref #97865
2019-03-22 01:41:51 [DEBUG   ] summary = ERROR
2019-03-22 01:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97865  13 58564  6111107 A  ERRORERROR'
2019-03-22 01:41:51 [DEBUG   ] Got command RPT from MCS: ref #97866
2019-03-22 01:41:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97866  77 58564  6111299 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:41:51 [DEBUG   ] Got command RPT from MCS: ref #97867
2019-03-22 01:41:51 [DEBUG   ] summary = ERROR
2019-03-22 01:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97867  13 58564  6111503 A  ERRORERROR'
2019-03-22 01:41:51 [DEBUG   ] Got command RPT from MCS: ref #97868
2019-03-22 01:41:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97868  77 58564  6111707 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:41:51 [DEBUG   ] Got command RPT from MCS: ref #97869
2019-03-22 01:41:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97869  12 58564  6111911 A  ERRORB“™š'
2019-03-22 01:41:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:41:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:41:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:41:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:41:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:41:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:41:53 [DEBUG   ] Finished updating board flags in 1.169 seconds
2019-03-22 01:42:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:42:29 [DEBUG   ] Finished updating ant stats in 1.801 seconds
2019-03-22 01:42:40 [DEBUG   ] Got command RPT from MCS: ref #97876
2019-03-22 01:42:40 [DEBUG   ] summary = ERROR
2019-03-22 01:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97876  13 58564  6160927 A  ERRORERROR'
2019-03-22 01:42:40 [DEBUG   ] Got command RPT from MCS: ref #97877
2019-03-22 01:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97877  77 58564  6160927 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:42:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 01:42:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:42:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:42:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:42:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:42:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:42:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:42:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:42:53 [DEBUG   ] Finished updating board flags in 1.065 seconds
2019-03-22 01:43:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:43:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:43:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 01:43:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:43:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:43:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:43:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:43:53 [WARNING ] (13, 1, 'bot')
2019-03-22 01:43:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:43:53 [DEBUG   ] Finished updating board flags in 1.476 seconds
2019-03-22 01:44:08 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 01:44:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 01:44:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 01:44:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:44:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:44:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:44:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:44:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:44:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:44:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:44:54 [DEBUG   ] Finished updating board flags in 1.931 seconds
2019-03-22 01:45:08 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 01:45:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 01:45:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 01:45:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:45:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:45:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:45:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:45:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:45:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:45:54 [DEBUG   ] Finished updating board flags in 1.739 seconds
2019-03-22 01:46:00 [DEBUG   ] Got command TBN from MCS: ref #97899
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-03-22 01:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    97899   8 58564  6360591 A  ERROR'
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1553219162']
2019-03-22 01:46:00 [DEBUG   ] spawn_process: at 2019-03-22 01:46:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1553219162']
2019-03-22 01:46:00 [INFO    ] Finished spawning TBN in 0.054 s
2019-03-22 01:46:08 [DEBUG   ] Finished updating ant stats in 0.468 seconds
2019-03-22 01:46:29 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-03-22 01:46:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 01:46:51 [DEBUG   ] Got command RPT from MCS: ref #97902
2019-03-22 01:46:51 [DEBUG   ] summary = ERROR
2019-03-22 01:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97902  13 58564  6411187 A  ERRORERROR'
2019-03-22 01:46:51 [DEBUG   ] Got command RPT from MCS: ref #97903
2019-03-22 01:46:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97903  77 58564  6411391 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:46:51 [DEBUG   ] Got command RPT from MCS: ref #97904
2019-03-22 01:46:51 [DEBUG   ] summary = ERROR
2019-03-22 01:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97904  13 58564  6411595 A  ERRORERROR'
2019-03-22 01:46:51 [DEBUG   ] Got command RPT from MCS: ref #97906
2019-03-22 01:46:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97906  77 58564  6411787 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:46:51 [DEBUG   ] Got command RPT from MCS: ref #97908
2019-03-22 01:46:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97908  12 58564  6411991 A  ERRORB’™š'
2019-03-22 01:46:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:46:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:46:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:46:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:46:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:46:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:46:54 [DEBUG   ] Finished updating board flags in 1.842 seconds
2019-03-22 01:47:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:47:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 01:47:40 [DEBUG   ] Got command RPT from MCS: ref #97912
2019-03-22 01:47:40 [DEBUG   ] summary = ERROR
2019-03-22 01:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97912  13 58564  6460931 A  ERRORERROR'
2019-03-22 01:47:40 [DEBUG   ] Got command RPT from MCS: ref #97913
2019-03-22 01:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97913  77 58564  6460931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:47:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:47:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:47:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:47:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:47:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:47:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:47:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:47:54 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-03-22 01:48:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 01:48:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:48:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 01:48:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:48:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:48:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:48:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:48:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:48:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:48:54 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-03-22 01:49:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 01:49:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 01:49:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:49:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:49:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:49:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:49:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:49:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:49:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:49:54 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-03-22 01:50:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-03-22 01:50:11 [DEBUG   ] Got command TBW from MCS: ref #97936
2019-03-22 01:50:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-03-22 01:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    97936   8 58564  6611663 A  ERROR'
2019-03-22 01:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-03-22 01:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-03-22 01:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-03-22 01:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-03-22 01:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-03-22 01:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-03-22 01:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-03-22 01:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-03-22 01:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-03-22 01:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-03-22 01:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-03-22 01:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-03-22 01:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-03-22 01:50:15 [DEBUG   ] spawn_process: at 2019-03-22 01:50:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-03-22 01:50:15 [INFO    ] Finished spawning TBW
2019-03-22 01:50:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:50:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:50:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:50:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:50:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:50:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:50:54 [DEBUG   ] Finished updating board flags in 1.484 seconds
2019-03-22 01:51:51 [DEBUG   ] Got command RPT from MCS: ref #97947
2019-03-22 01:51:51 [DEBUG   ] summary = ERROR
2019-03-22 01:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97947  13 58564  6711275 A  ERRORERROR'
2019-03-22 01:51:51 [DEBUG   ] Got command RPT from MCS: ref #97948
2019-03-22 01:51:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97948  77 58564  6711479 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:51:51 [DEBUG   ] Got command RPT from MCS: ref #97949
2019-03-22 01:51:51 [DEBUG   ] summary = ERROR
2019-03-22 01:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97949  13 58564  6711671 A  ERRORERROR'
2019-03-22 01:51:51 [DEBUG   ] Got command RPT from MCS: ref #97950
2019-03-22 01:51:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97950  77 58564  6711875 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:51:52 [DEBUG   ] Got command RPT from MCS: ref #97951
2019-03-22 01:51:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97951  12 58564  6712079 A  ERRORB“™š'
2019-03-22 01:51:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:51:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 01:51:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:51:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:51:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:51:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:51:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:51:54 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-03-22 01:52:03 [INFO    ] __waitForTBW - TBW finished in 108.667 s
2019-03-22 01:52:04 [DEBUG   ] Finished updating ant stats in 0.380 seconds
2019-03-22 01:52:04 [INFO    ] Started antennas statistics background thread
2019-03-22 01:52:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1553219526']
2019-03-22 01:52:04 [DEBUG   ] spawn_process: at 2019-03-22 01:52:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1553219526']
2019-03-22 01:52:04 [INFO    ] Finished spawning TBN in 0.056 s
2019-03-22 01:52:25 [DEBUG   ] Finished updating ant stats in 1.268 seconds
2019-03-22 01:52:40 [DEBUG   ] Got command RPT from MCS: ref #97953
2019-03-22 01:52:40 [DEBUG   ] summary = ERROR
2019-03-22 01:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97953  13 58564  6760935 A  ERRORERROR'
2019-03-22 01:52:40 [DEBUG   ] Got command RPT from MCS: ref #97954
2019-03-22 01:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97954  77 58564  6760935 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:52:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 01:52:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 01:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:52:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:52:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:52:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:52:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:52:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:52:54 [DEBUG   ] Finished updating board flags in 1.658 seconds
2019-03-22 01:53:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:53:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 01:53:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 01:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 01:53:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:53:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:53:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:53:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:53:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:53:54 [DEBUG   ] Finished updating board flags in 1.641 seconds
2019-03-22 01:54:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 01:54:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 01:54:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 01:54:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:54:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:54:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:54:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:54:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:54:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:54:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:54:54 [DEBUG   ] Finished updating board flags in 1.641 seconds
2019-03-22 01:55:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:55:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 01:55:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:55:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:55:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:55:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:55:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:55:54 [WARNING ] (13, 1, 'bot')
2019-03-22 01:55:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:55:54 [DEBUG   ] Finished updating board flags in 1.644 seconds
2019-03-22 01:56:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:56:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:56:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 01:56:51 [DEBUG   ] Got command RPT from MCS: ref #97980
2019-03-22 01:56:51 [DEBUG   ] summary = ERROR
2019-03-22 01:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97980  13 58564  7011363 A  ERRORERROR'
2019-03-22 01:56:51 [DEBUG   ] Got command RPT from MCS: ref #97981
2019-03-22 01:56:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97981  77 58564  7011567 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:56:51 [DEBUG   ] Got command RPT from MCS: ref #97982
2019-03-22 01:56:51 [DEBUG   ] summary = ERROR
2019-03-22 01:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97982  13 58564  7011759 A  ERRORERROR'
2019-03-22 01:56:51 [DEBUG   ] Got command RPT from MCS: ref #97984
2019-03-22 01:56:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97984  77 58564  7011963 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:56:52 [DEBUG   ] Got command RPT from MCS: ref #97985
2019-03-22 01:56:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 01:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97985  12 58564  7012167 A  ERRORB“™š'
2019-03-22 01:56:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:56:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 01:56:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:56:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:56:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:56:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:56:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:56:55 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-03-22 01:57:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 01:57:25 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-03-22 01:57:40 [DEBUG   ] Got command RPT from MCS: ref #97996
2019-03-22 01:57:40 [DEBUG   ] summary = ERROR
2019-03-22 01:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97996  13 58564  7060935 A  ERRORERROR'
2019-03-22 01:57:40 [DEBUG   ] Got command RPT from MCS: ref #97997
2019-03-22 01:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 01:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    97997  77 58564  7060935 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 01:57:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 01:57:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:57:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:57:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:57:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:57:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:57:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:57:55 [DEBUG   ] Finished updating board flags in 1.650 seconds
2019-03-22 01:58:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 01:58:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 01:58:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:58:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:58:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:58:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:58:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:58:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:58:55 [DEBUG   ] Finished updating board flags in 2.318 seconds
2019-03-22 01:59:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 01:59:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 01:59:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 01:59:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 01:59:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 01:59:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:59:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:59:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:59:55 [WARNING ] (13, 1, 'bot')
2019-03-22 01:59:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 01:59:55 [DEBUG   ] Finished updating board flags in 2.069 seconds
2019-03-22 02:00:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:00:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:00:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 02:00:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:00:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:00:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:00:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:00:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:00:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:00:55 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-03-22 02:01:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:01:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:01:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:01:51 [DEBUG   ] Got command RPT from MCS: ref #98019
2019-03-22 02:01:51 [DEBUG   ] summary = ERROR
2019-03-22 02:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98019  13 58564  7311451 A  ERRORERROR'
2019-03-22 02:01:51 [DEBUG   ] Got command RPT from MCS: ref #98020
2019-03-22 02:01:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98020  77 58564  7311643 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:01:51 [DEBUG   ] Got command RPT from MCS: ref #98021
2019-03-22 02:01:51 [DEBUG   ] summary = ERROR
2019-03-22 02:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98021  13 58564  7311847 A  ERRORERROR'
2019-03-22 02:01:52 [DEBUG   ] Got command RPT from MCS: ref #98022
2019-03-22 02:01:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98022  77 58564  7312051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:01:52 [DEBUG   ] Got command RPT from MCS: ref #98023
2019-03-22 02:01:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98023  12 58564  7312255 A  ERRORB’™š'
2019-03-22 02:01:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:01:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:01:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:01:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:01:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:01:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:01:55 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-03-22 02:02:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:02:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:02:40 [DEBUG   ] Got command RPT from MCS: ref #98024
2019-03-22 02:02:40 [DEBUG   ] summary = ERROR
2019-03-22 02:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98024  13 58564  7360931 A  ERRORERROR'
2019-03-22 02:02:40 [DEBUG   ] Got command RPT from MCS: ref #98025
2019-03-22 02:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98025  77 58564  7360931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:02:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:02:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:02:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:02:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:02:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:02:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:02:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:02:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:02:55 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-03-22 02:03:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:03:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:03:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:03:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:03:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:03:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:03:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:03:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:03:55 [DEBUG   ] Finished updating board flags in 1.921 seconds
2019-03-22 02:04:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 02:04:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:04:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 02:04:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:04:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 02:04:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:04:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:04:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:04:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:04:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:04:55 [DEBUG   ] Finished updating board flags in 1.686 seconds
2019-03-22 02:05:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:05:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:05:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:05:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 02:05:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:05:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:05:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:05:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:05:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:05:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:05:55 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-03-22 02:06:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 02:06:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:06:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:06:51 [DEBUG   ] Got command RPT from MCS: ref #98060
2019-03-22 02:06:51 [DEBUG   ] summary = ERROR
2019-03-22 02:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98060  13 58564  7611527 A  ERRORERROR'
2019-03-22 02:06:51 [DEBUG   ] Got command RPT from MCS: ref #98061
2019-03-22 02:06:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98061  77 58564  7611731 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:06:51 [DEBUG   ] Got command RPT from MCS: ref #98062
2019-03-22 02:06:51 [DEBUG   ] summary = ERROR
2019-03-22 02:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98062  13 58564  7611935 A  ERRORERROR'
2019-03-22 02:06:52 [DEBUG   ] Got command RPT from MCS: ref #98064
2019-03-22 02:06:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98064  77 58564  7612139 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:06:52 [DEBUG   ] Got command RPT from MCS: ref #98065
2019-03-22 02:06:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98065  12 58564  7612331 A  ERRORB’™š'
2019-03-22 02:06:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:06:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:06:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:06:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:06:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:06:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:06:55 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-03-22 02:07:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:07:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:07:40 [DEBUG   ] Got command RPT from MCS: ref #98075
2019-03-22 02:07:40 [DEBUG   ] summary = ERROR
2019-03-22 02:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98075  13 58564  7660939 A  ERRORERROR'
2019-03-22 02:07:40 [DEBUG   ] Got command RPT from MCS: ref #98076
2019-03-22 02:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98076  77 58564  7660939 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:07:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:07:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 02:07:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:07:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:07:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:07:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:07:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:07:55 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-03-22 02:08:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 02:08:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 02:08:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 02:08:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:08:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:08:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:08:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:08:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:08:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:08:55 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-03-22 02:09:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 02:09:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 02:09:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 02:09:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:09:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:09:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:09:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:09:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:09:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:09:55 [DEBUG   ] Finished updating board flags in 1.562 seconds
2019-03-22 02:10:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 02:10:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:10:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:10:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:10:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:10:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:10:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:10:55 [WARNING ] (13, 1, 'bot')
2019-03-22 02:10:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:10:55 [DEBUG   ] Finished updating board flags in 1.563 seconds
2019-03-22 02:11:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:11:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:11:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:11:51 [DEBUG   ] Got command RPT from MCS: ref #98098
2019-03-22 02:11:51 [DEBUG   ] summary = ERROR
2019-03-22 02:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98098  13 58564  7911615 A  ERRORERROR'
2019-03-22 02:11:51 [DEBUG   ] Got command RPT from MCS: ref #98099
2019-03-22 02:11:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98099  77 58564  7911819 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:11:52 [DEBUG   ] Got command RPT from MCS: ref #98100
2019-03-22 02:11:52 [DEBUG   ] summary = ERROR
2019-03-22 02:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98100  13 58564  7912023 A  ERRORERROR'
2019-03-22 02:11:52 [DEBUG   ] Got command RPT from MCS: ref #98101
2019-03-22 02:11:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98101  77 58564  7912227 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:11:52 [DEBUG   ] Got command RPT from MCS: ref #98102
2019-03-22 02:11:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98102  12 58564  7912419 A  ERRORB’™š'
2019-03-22 02:11:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:11:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:11:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:11:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:11:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:11:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:11:56 [DEBUG   ] Finished updating board flags in 2.187 seconds
2019-03-22 02:12:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:12:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:12:40 [DEBUG   ] Got command RPT from MCS: ref #98109
2019-03-22 02:12:40 [DEBUG   ] summary = ERROR
2019-03-22 02:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98109  13 58564  7960935 A  ERRORERROR'
2019-03-22 02:12:40 [DEBUG   ] Got command RPT from MCS: ref #98110
2019-03-22 02:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98110  77 58564  7960935 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:12:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:12:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:12:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:12:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:12:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:12:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:12:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:12:56 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-03-22 02:13:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:13:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 02:13:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:13:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:13:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:13:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:13:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:13:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:13:56 [DEBUG   ] Finished updating board flags in 1.878 seconds
2019-03-22 02:14:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 02:14:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:14:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:14:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:14:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:14:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:14:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:14:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:14:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:14:56 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-03-22 02:15:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:15:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:15:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:15:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:15:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:15:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:15:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:15:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:15:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:15:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:15:56 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-03-22 02:16:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:16:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:16:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:16:51 [DEBUG   ] Got command RPT from MCS: ref #98134
2019-03-22 02:16:51 [DEBUG   ] summary = ERROR
2019-03-22 02:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98134  13 58564  8211699 A  ERRORERROR'
2019-03-22 02:16:51 [DEBUG   ] Got command RPT from MCS: ref #98135
2019-03-22 02:16:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98135  77 58564  8211903 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:16:52 [DEBUG   ] Got command RPT from MCS: ref #98136
2019-03-22 02:16:52 [DEBUG   ] summary = ERROR
2019-03-22 02:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98136  13 58564  8212107 A  ERRORERROR'
2019-03-22 02:16:52 [DEBUG   ] Got command RPT from MCS: ref #98138
2019-03-22 02:16:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98138  77 58564  8212311 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:16:52 [DEBUG   ] Got command RPT from MCS: ref #98139
2019-03-22 02:16:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98139  12 58564  8212503 A  ERRORB’™š'
2019-03-22 02:16:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:16:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:16:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:16:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:16:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:16:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:16:56 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-03-22 02:17:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:17:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:17:40 [DEBUG   ] Got command RPT from MCS: ref #98144
2019-03-22 02:17:40 [DEBUG   ] summary = ERROR
2019-03-22 02:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98144  13 58564  8260935 A  ERRORERROR'
2019-03-22 02:17:40 [DEBUG   ] Got command RPT from MCS: ref #98145
2019-03-22 02:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98145  77 58564  8260935 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:17:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:17:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:17:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:17:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:17:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:17:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:17:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:17:56 [DEBUG   ] Finished updating board flags in 1.669 seconds
2019-03-22 02:18:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:18:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:18:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:18:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:18:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:18:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:18:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:18:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:18:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:18:56 [DEBUG   ] Finished updating board flags in 1.560 seconds
2019-03-22 02:19:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:19:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 02:19:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:19:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:19:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:19:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:19:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:19:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:19:56 [DEBUG   ] Finished updating board flags in 1.533 seconds
2019-03-22 02:20:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:20:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:20:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:20:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:20:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:20:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:20:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:20:56 [WARNING ] (13, 1, 'bot')
2019-03-22 02:20:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:20:56 [DEBUG   ] Finished updating board flags in 1.538 seconds
2019-03-22 02:21:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:21:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:21:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:21:51 [DEBUG   ] Got command RPT from MCS: ref #98173
2019-03-22 02:21:51 [DEBUG   ] summary = ERROR
2019-03-22 02:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98173  13 58564  8511791 A  ERRORERROR'
2019-03-22 02:21:51 [DEBUG   ] Got command RPT from MCS: ref #98174
2019-03-22 02:21:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98174  77 58564  8511995 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:21:52 [DEBUG   ] Got command RPT from MCS: ref #98175
2019-03-22 02:21:52 [DEBUG   ] summary = ERROR
2019-03-22 02:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98175  13 58564  8512187 A  ERRORERROR'
2019-03-22 02:21:52 [DEBUG   ] Got command RPT from MCS: ref #98176
2019-03-22 02:21:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98176  77 58564  8512391 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:21:52 [DEBUG   ] Got command RPT from MCS: ref #98177
2019-03-22 02:21:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98177  12 58564  8512595 A  ERRORB’™š'
2019-03-22 02:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:21:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:21:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:21:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:21:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:21:57 [DEBUG   ] Finished updating board flags in 2.153 seconds
2019-03-22 02:22:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 02:22:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:22:40 [DEBUG   ] Got command RPT from MCS: ref #98178
2019-03-22 02:22:40 [DEBUG   ] summary = ERROR
2019-03-22 02:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98178  13 58564  8560943 A  ERRORERROR'
2019-03-22 02:22:40 [DEBUG   ] Got command RPT from MCS: ref #98179
2019-03-22 02:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98179  77 58564  8560943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:22:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 02:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:22:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 02:22:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:22:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:22:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:22:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:22:57 [DEBUG   ] Finished updating board flags in 2.036 seconds
2019-03-22 02:23:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:23:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 02:23:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:23:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:23:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:23:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:23:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:23:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:23:57 [DEBUG   ] Finished updating board flags in 1.937 seconds
2019-03-22 02:24:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 02:24:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:24:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:24:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:24:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:24:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:24:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:24:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:24:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:24:57 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-03-22 02:25:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:25:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:25:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:25:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:25:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:25:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:25:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:25:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:25:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:25:57 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-03-22 02:26:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:26:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:26:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:26:51 [DEBUG   ] Got command RPT from MCS: ref #98203
2019-03-22 02:26:51 [DEBUG   ] summary = ERROR
2019-03-22 02:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98203  13 58564  8811883 A  ERRORERROR'
2019-03-22 02:26:52 [DEBUG   ] Got command RPT from MCS: ref #98204
2019-03-22 02:26:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98204  77 58564  8812075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:26:52 [DEBUG   ] Got command RPT from MCS: ref #98205
2019-03-22 02:26:52 [DEBUG   ] summary = ERROR
2019-03-22 02:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98205  13 58564  8812279 A  ERRORERROR'
2019-03-22 02:26:52 [DEBUG   ] Got command RPT from MCS: ref #98207
2019-03-22 02:26:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98207  77 58564  8812483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:26:52 [DEBUG   ] Got command RPT from MCS: ref #98208
2019-03-22 02:26:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98208  12 58564  8812675 A  ERRORB’™š'
2019-03-22 02:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:26:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:26:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:26:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:26:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:26:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:26:57 [DEBUG   ] Finished updating board flags in 1.460 seconds
2019-03-22 02:27:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:27:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 02:27:40 [DEBUG   ] Got command RPT from MCS: ref #98219
2019-03-22 02:27:40 [DEBUG   ] summary = ERROR
2019-03-22 02:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98219  13 58564  8860935 A  ERRORERROR'
2019-03-22 02:27:40 [DEBUG   ] Got command RPT from MCS: ref #98220
2019-03-22 02:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98220  77 58564  8860935 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:27:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:27:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:27:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:27:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:27:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:27:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:27:57 [DEBUG   ] Finished updating board flags in 1.535 seconds
2019-03-22 02:28:05 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 02:28:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 02:28:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 02:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:28:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:28:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:28:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:28:57 [WARNING ] (13, 1, 'bot')
2019-03-22 02:28:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:28:57 [DEBUG   ] Finished updating board flags in 1.537 seconds
2019-03-22 02:29:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 02:29:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 02:29:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 02:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:29:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:29:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:29:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:29:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:29:58 [DEBUG   ] Finished updating board flags in 2.179 seconds
2019-03-22 02:30:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 02:30:26 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 02:30:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:30:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:30:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:30:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:30:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:30:58 [DEBUG   ] Finished updating board flags in 1.931 seconds
2019-03-22 02:31:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:31:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 02:31:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:31:51 [DEBUG   ] Got command RPT from MCS: ref #98242
2019-03-22 02:31:51 [DEBUG   ] summary = ERROR
2019-03-22 02:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98242  13 58564  9111967 A  ERRORERROR'
2019-03-22 02:31:52 [DEBUG   ] Got command RPT from MCS: ref #98243
2019-03-22 02:31:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98243  77 58564  9112159 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:31:52 [DEBUG   ] Got command RPT from MCS: ref #98244
2019-03-22 02:31:52 [DEBUG   ] summary = ERROR
2019-03-22 02:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98244  13 58564  9112363 A  ERRORERROR'
2019-03-22 02:31:52 [DEBUG   ] Got command RPT from MCS: ref #98245
2019-03-22 02:31:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98245  77 58564  9112567 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:31:52 [DEBUG   ] Got command RPT from MCS: ref #98246
2019-03-22 02:31:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98246  12 58564  9112771 A  ERRORB’™š'
2019-03-22 02:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:31:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:31:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:31:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:31:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:31:58 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-03-22 02:32:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 02:32:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:32:40 [DEBUG   ] Got command RPT from MCS: ref #98247
2019-03-22 02:32:40 [DEBUG   ] summary = ERROR
2019-03-22 02:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98247  13 58564  9160943 A  ERRORERROR'
2019-03-22 02:32:40 [DEBUG   ] Got command RPT from MCS: ref #98248
2019-03-22 02:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98248  77 58564  9160943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:32:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:32:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:32:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:32:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:32:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:32:58 [DEBUG   ] Finished updating board flags in 1.761 seconds
2019-03-22 02:33:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:33:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:33:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 02:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 02:33:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:33:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:33:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:33:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:33:58 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-03-22 02:34:06 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 02:34:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 02:34:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 02:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:34:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:34:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:34:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:34:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:34:58 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-03-22 02:35:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 02:35:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 02:35:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 02:35:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:35:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:35:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:35:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:35:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:35:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:35:58 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-03-22 02:36:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 02:36:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 02:36:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 02:36:52 [DEBUG   ] Got command RPT from MCS: ref #98278
2019-03-22 02:36:52 [DEBUG   ] summary = ERROR
2019-03-22 02:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98278  13 58564  9412055 A  ERRORERROR'
2019-03-22 02:36:52 [DEBUG   ] Got command RPT from MCS: ref #98279
2019-03-22 02:36:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98279  77 58564  9412247 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:36:52 [DEBUG   ] Got command RPT from MCS: ref #98280
2019-03-22 02:36:52 [DEBUG   ] summary = ERROR
2019-03-22 02:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98280  13 58564  9412451 A  ERRORERROR'
2019-03-22 02:36:52 [DEBUG   ] Got command RPT from MCS: ref #98282
2019-03-22 02:36:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98282  77 58564  9412655 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:36:52 [DEBUG   ] Got command RPT from MCS: ref #98284
2019-03-22 02:36:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98284  12 58564  9412859 A  ERRORB’™š'
2019-03-22 02:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:36:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:36:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:36:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:36:58 [WARNING ] (13, 1, 'bot')
2019-03-22 02:36:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:36:58 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-03-22 02:37:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 02:37:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 02:37:40 [DEBUG   ] Got command RPT from MCS: ref #98288
2019-03-22 02:37:40 [DEBUG   ] summary = ERROR
2019-03-22 02:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98288  13 58564  9460939 A  ERRORERROR'
2019-03-22 02:37:40 [DEBUG   ] Got command RPT from MCS: ref #98289
2019-03-22 02:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98289  77 58564  9460939 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:37:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 02:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:37:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:37:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:37:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:37:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:37:59 [DEBUG   ] Finished updating board flags in 2.296 seconds
2019-03-22 02:38:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 02:38:26 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 02:38:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:38:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:38:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:38:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:38:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:38:59 [DEBUG   ] Finished updating board flags in 2.107 seconds
2019-03-22 02:39:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 02:39:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:39:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:39:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:39:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:39:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:39:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:39:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:39:59 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-03-22 02:40:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:40:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 02:40:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 02:40:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 02:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 02:40:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:40:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:40:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:40:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:40:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:40:59 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-03-22 02:41:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:41:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:41:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:41:52 [DEBUG   ] Got command RPT from MCS: ref #98311
2019-03-22 02:41:52 [DEBUG   ] summary = ERROR
2019-03-22 02:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98311  13 58564  9712135 A  ERRORERROR'
2019-03-22 02:41:52 [DEBUG   ] Got command RPT from MCS: ref #98312
2019-03-22 02:41:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98312  77 58564  9712339 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:41:52 [DEBUG   ] Got command RPT from MCS: ref #98313
2019-03-22 02:41:52 [DEBUG   ] summary = ERROR
2019-03-22 02:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98313  13 58564  9712543 A  ERRORERROR'
2019-03-22 02:41:52 [DEBUG   ] Got command RPT from MCS: ref #98314
2019-03-22 02:41:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98314  77 58564  9712735 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:41:52 [DEBUG   ] Got command RPT from MCS: ref #98315
2019-03-22 02:41:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98315  12 58564  9712939 A  ERRORB”™š'
2019-03-22 02:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:41:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:41:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:41:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:41:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:41:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:41:59 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-03-22 02:42:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 02:42:27 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-03-22 02:42:40 [DEBUG   ] Got command RPT from MCS: ref #98322
2019-03-22 02:42:40 [DEBUG   ] summary = ERROR
2019-03-22 02:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98322  13 58564  9760947 A  ERRORERROR'
2019-03-22 02:42:40 [DEBUG   ] Got command RPT from MCS: ref #98323
2019-03-22 02:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98323  77 58564  9760947 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:42:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 02:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 02:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:42:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:42:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:42:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:42:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:42:59 [DEBUG   ] Finished updating board flags in 1.957 seconds
2019-03-22 02:43:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 02:43:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 02:43:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 02:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:43:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:43:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:43:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:43:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:43:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:43:59 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-03-22 02:44:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 02:44:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 02:44:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:44:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:44:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:44:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:44:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:44:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:44:59 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-03-22 02:45:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 02:45:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:45:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 02:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2019-03-22 02:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:45:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:45:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:45:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:45:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:45:59 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-03-22 02:46:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 02:46:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 02:46:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:46:52 [DEBUG   ] Got command RPT from MCS: ref #98347
2019-03-22 02:46:52 [DEBUG   ] summary = ERROR
2019-03-22 02:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98347  13 58564 10012227 A  ERRORERROR'
2019-03-22 02:46:52 [DEBUG   ] Got command RPT from MCS: ref #98348
2019-03-22 02:46:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98348  77 58564 10012419 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:46:52 [DEBUG   ] Got command RPT from MCS: ref #98349
2019-03-22 02:46:52 [DEBUG   ] summary = ERROR
2019-03-22 02:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98349  13 58564 10012623 A  ERRORERROR'
2019-03-22 02:46:52 [DEBUG   ] Got command RPT from MCS: ref #98351
2019-03-22 02:46:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98351  77 58564 10012827 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:46:53 [DEBUG   ] Got command RPT from MCS: ref #98352
2019-03-22 02:46:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98352  12 58564 10013031 A  ERRORB•™š'
2019-03-22 02:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:46:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:46:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:46:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:46:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:46:59 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-03-22 02:47:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:47:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:47:40 [DEBUG   ] Got command RPT from MCS: ref #98357
2019-03-22 02:47:40 [DEBUG   ] summary = ERROR
2019-03-22 02:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98357  13 58564 10060943 A  ERRORERROR'
2019-03-22 02:47:40 [DEBUG   ] Got command RPT from MCS: ref #98358
2019-03-22 02:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98358  77 58564 10060943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:47:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 02:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:47:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:47:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:47:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:47:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:47:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:47:59 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-03-22 02:48:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 02:48:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 02:48:48 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 02:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:48:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:48:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:48:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:48:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:48:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:48:59 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-03-22 02:49:08 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 02:49:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 02:49:48 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 02:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:49:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:49:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:49:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:49:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:49:59 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-03-22 02:50:08 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-03-22 02:50:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 02:50:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 02:50:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:50:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:50:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:50:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:50:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:50:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:50:59 [DEBUG   ] Finished updating board flags in 1.447 seconds
2019-03-22 02:51:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 02:51:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 02:51:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 02:51:52 [DEBUG   ] Got command RPT from MCS: ref #98386
2019-03-22 02:51:52 [DEBUG   ] summary = ERROR
2019-03-22 02:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98386  13 58564 10312303 A  ERRORERROR'
2019-03-22 02:51:52 [DEBUG   ] Got command RPT from MCS: ref #98387
2019-03-22 02:51:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98387  77 58564 10312507 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:51:52 [DEBUG   ] Got command RPT from MCS: ref #98388
2019-03-22 02:51:52 [DEBUG   ] summary = ERROR
2019-03-22 02:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98388  13 58564 10312711 A  ERRORERROR'
2019-03-22 02:51:52 [DEBUG   ] Got command RPT from MCS: ref #98389
2019-03-22 02:51:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98389  77 58564 10312915 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:51:53 [DEBUG   ] Got command RPT from MCS: ref #98390
2019-03-22 02:51:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98390  12 58564 10313107 A  ERRORB”™š'
2019-03-22 02:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:51:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:51:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:51:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:51:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:51:59 [DEBUG   ] Finished updating board flags in 1.457 seconds
2019-03-22 02:52:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 02:52:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 02:52:40 [DEBUG   ] Got command RPT from MCS: ref #98391
2019-03-22 02:52:40 [DEBUG   ] summary = ERROR
2019-03-22 02:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98391  13 58564 10360947 A  ERRORERROR'
2019-03-22 02:52:40 [DEBUG   ] Got command RPT from MCS: ref #98392
2019-03-22 02:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98392  77 58564 10360947 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:52:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 02:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:52:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:52:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:52:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:52:59 [WARNING ] (13, 1, 'bot')
2019-03-22 02:52:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:52:59 [DEBUG   ] Finished updating board flags in 1.475 seconds
2019-03-22 02:53:08 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 02:53:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 02:53:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 02:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:54:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 02:54:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:54:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:54:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:54:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:54:00 [DEBUG   ] Finished updating board flags in 2.264 seconds
2019-03-22 02:54:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:54:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:54:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:55:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:55:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:55:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:55:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:55:00 [DEBUG   ] Finished updating board flags in 2.215 seconds
2019-03-22 02:55:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:55:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 02:55:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:56:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:56:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:56:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:56:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:56:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:56:00 [DEBUG   ] Finished updating board flags in 2.230 seconds
2019-03-22 02:56:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 02:56:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:56:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:56:52 [DEBUG   ] Got command RPT from MCS: ref #98416
2019-03-22 02:56:52 [DEBUG   ] summary = ERROR
2019-03-22 02:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98416  13 58564 10612391 A  ERRORERROR'
2019-03-22 02:56:52 [DEBUG   ] Got command RPT from MCS: ref #98417
2019-03-22 02:56:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98417  77 58564 10612595 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:56:52 [DEBUG   ] Got command RPT from MCS: ref #98418
2019-03-22 02:56:52 [DEBUG   ] summary = ERROR
2019-03-22 02:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98418  13 58564 10612799 A  ERRORERROR'
2019-03-22 02:56:52 [DEBUG   ] Got command RPT from MCS: ref #98420
2019-03-22 02:56:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98420  77 58564 10612991 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:56:53 [DEBUG   ] Got command RPT from MCS: ref #98421
2019-03-22 02:56:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 02:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98421  12 58564 10613195 A  ERRORB”™š'
2019-03-22 02:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:57:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:57:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:57:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:57:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:57:00 [DEBUG   ] Finished updating board flags in 2.099 seconds
2019-03-22 02:57:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:57:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:57:40 [DEBUG   ] Got command RPT from MCS: ref #98432
2019-03-22 02:57:40 [DEBUG   ] summary = ERROR
2019-03-22 02:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98432  13 58564 10660951 A  ERRORERROR'
2019-03-22 02:57:40 [DEBUG   ] Got command RPT from MCS: ref #98433
2019-03-22 02:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 02:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98433  77 58564 10660951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 02:57:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:58:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:58:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:58:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:58:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:58:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:58:00 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-03-22 02:58:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:58:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:58:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 02:59:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:59:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:59:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:59:00 [WARNING ] (13, 1, 'bot')
2019-03-22 02:59:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 02:59:00 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-03-22 02:59:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 02:59:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 02:59:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 02:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:00:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:00:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:00:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:00:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:00:00 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-03-22 03:00:08 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 03:00:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:00:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 03:00:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:01:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:01:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:01:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:01:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:01:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:01:00 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-03-22 03:01:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:01:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:01:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:01:52 [DEBUG   ] Got command RPT from MCS: ref #98455
2019-03-22 03:01:52 [DEBUG   ] summary = ERROR
2019-03-22 03:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98455  13 58564 10912475 A  ERRORERROR'
2019-03-22 03:01:52 [DEBUG   ] Got command RPT from MCS: ref #98456
2019-03-22 03:01:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98456  77 58564 10912679 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:01:52 [DEBUG   ] Got command RPT from MCS: ref #98457
2019-03-22 03:01:52 [DEBUG   ] summary = ERROR
2019-03-22 03:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98457  13 58564 10912883 A  ERRORERROR'
2019-03-22 03:01:53 [DEBUG   ] Got command RPT from MCS: ref #98458
2019-03-22 03:01:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:01:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98458  77 58564 10913075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:01:53 [DEBUG   ] Got command RPT from MCS: ref #98459
2019-03-22 03:01:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:01:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98459  12 58564 10913279 A  ERRORB“™š'
2019-03-22 03:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:02:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:02:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:02:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:02:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:02:00 [DEBUG   ] Finished updating board flags in 1.700 seconds
2019-03-22 03:02:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 03:02:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:02:40 [DEBUG   ] Got command RPT from MCS: ref #98460
2019-03-22 03:02:40 [DEBUG   ] summary = ERROR
2019-03-22 03:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98460  13 58564 10960943 A  ERRORERROR'
2019-03-22 03:02:40 [DEBUG   ] Got command RPT from MCS: ref #98461
2019-03-22 03:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98461  77 58564 10960943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:02:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:02:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:03:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:03:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:03:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:03:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:03:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:03:00 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-03-22 03:03:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:03:29 [DEBUG   ] Finished updating ant stats in 1.801 seconds
2019-03-22 03:03:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:03:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:04:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:04:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:04:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:04:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:04:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:04:00 [DEBUG   ] Finished updating board flags in 1.493 seconds
2019-03-22 03:04:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:04:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:04:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 03:04:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:05:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:05:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:05:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:05:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:05:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:05:00 [DEBUG   ] Finished updating board flags in 1.467 seconds
2019-03-22 03:05:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:05:29 [DEBUG   ] Finished updating ant stats in 1.801 seconds
2019-03-22 03:05:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:06:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:06:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:06:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:06:00 [WARNING ] (13, 1, 'bot')
2019-03-22 03:06:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:06:00 [DEBUG   ] Finished updating board flags in 1.531 seconds
2019-03-22 03:06:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 03:06:28 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 03:06:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 03:06:52 [DEBUG   ] Got command RPT from MCS: ref #98491
2019-03-22 03:06:52 [DEBUG   ] summary = ERROR
2019-03-22 03:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98491  13 58564 11212567 A  ERRORERROR'
2019-03-22 03:06:52 [DEBUG   ] Got command RPT from MCS: ref #98492
2019-03-22 03:06:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98492  77 58564 11212759 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:06:52 [DEBUG   ] Got command RPT from MCS: ref #98493
2019-03-22 03:06:52 [DEBUG   ] summary = ERROR
2019-03-22 03:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98493  13 58564 11212963 A  ERRORERROR'
2019-03-22 03:06:53 [DEBUG   ] Got command RPT from MCS: ref #98495
2019-03-22 03:06:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98495  77 58564 11213167 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:06:53 [DEBUG   ] Got command RPT from MCS: ref #98496
2019-03-22 03:06:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98496  12 58564 11213371 A  ERRORB’™š'
2019-03-22 03:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:07:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 03:07:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:07:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:07:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:07:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:07:01 [DEBUG   ] Finished updating board flags in 2.245 seconds
2019-03-22 03:07:08 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-22 03:07:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 03:07:40 [DEBUG   ] Got command RPT from MCS: ref #98501
2019-03-22 03:07:40 [DEBUG   ] summary = ERROR
2019-03-22 03:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98501  13 58564 11260947 A  ERRORERROR'
2019-03-22 03:07:40 [DEBUG   ] Got command RPT from MCS: ref #98502
2019-03-22 03:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98502  77 58564 11260947 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:07:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 03:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 03:08:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:08:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:08:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:08:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:08:01 [DEBUG   ] Finished updating board flags in 2.155 seconds
2019-03-22 03:08:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 03:08:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 03:08:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 03:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 03:09:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:09:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:09:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:09:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:09:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:09:01 [DEBUG   ] Finished updating board flags in 2.074 seconds
2019-03-22 03:09:09 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 03:09:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:09:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 03:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 03:10:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:10:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:10:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:10:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:10:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:10:01 [DEBUG   ] Finished updating board flags in 1.936 seconds
2019-03-22 03:10:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:10:29 [DEBUG   ] Finished updating ant stats in 0.988 seconds
2019-03-22 03:10:49 [DEBUG   ] Finished updating ant stats in 0.784 seconds
2019-03-22 03:11:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:11:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:11:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:11:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:11:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:11:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:11:01 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-03-22 03:11:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 03:11:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:11:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 03:11:52 [DEBUG   ] Got command RPT from MCS: ref #98524
2019-03-22 03:11:52 [DEBUG   ] summary = ERROR
2019-03-22 03:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98524  13 58564 11512643 A  ERRORERROR'
2019-03-22 03:11:52 [DEBUG   ] Got command RPT from MCS: ref #98525
2019-03-22 03:11:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98525  77 58564 11512847 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:11:53 [DEBUG   ] Got command RPT from MCS: ref #98526
2019-03-22 03:11:53 [DEBUG   ] summary = ERROR
2019-03-22 03:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98526  13 58564 11513051 A  ERRORERROR'
2019-03-22 03:11:53 [DEBUG   ] Got command RPT from MCS: ref #98527
2019-03-22 03:11:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98527  77 58564 11513243 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:11:53 [DEBUG   ] Got command RPT from MCS: ref #98528
2019-03-22 03:11:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98528  12 58564 11513447 A  ERRORB’™š'
2019-03-22 03:12:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:12:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:12:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:12:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:12:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:12:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:12:01 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-03-22 03:12:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:12:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 03:12:40 [DEBUG   ] Got command RPT from MCS: ref #98535
2019-03-22 03:12:40 [DEBUG   ] summary = ERROR
2019-03-22 03:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98535  13 58564 11560943 A  ERRORERROR'
2019-03-22 03:12:40 [DEBUG   ] Got command RPT from MCS: ref #98536
2019-03-22 03:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98536  77 58564 11560943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:12:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 03:13:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:13:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 03:13:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:13:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:13:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:13:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:13:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:13:01 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-03-22 03:13:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 03:13:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 03:13:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 03:14:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:14:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:14:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:14:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:14:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:14:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:14:01 [DEBUG   ] Finished updating board flags in 1.835 seconds
2019-03-22 03:14:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 03:14:29 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-22 03:14:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 03:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:15:00 [DEBUG   ] Got command RPT from MCS: ref #98558
2019-03-22 03:15:00 [DEBUG   ] summary = ERROR
2019-03-22 03:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98558  13 58564 11700663 A  ERRORERROR'
2019-03-22 03:15:00 [DEBUG   ] Got command RPT from MCS: ref #98559
2019-03-22 03:15:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98559  77 58564 11700663 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:15:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:15:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:15:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:15:01 [WARNING ] (13, 1, 'bot')
2019-03-22 03:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:15:01 [DEBUG   ] Finished updating board flags in 1.733 seconds
2019-03-22 03:15:05 [DEBUG   ] Got command INI from MCS: ref #98560
2019-03-22 03:15:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-03-22 03:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    98560   8 58564 11705675 ABOOTING'
2019-03-22 03:15:09 [WARNING ] AntennaStats: no access to lwa28
2019-03-22 03:15:09 [WARNING ] AntennaStats: last command was /usr/local/bin/lwa28 /lwa/software/amplitude
2019-03-22 03:15:09 [WARNING ] AntennaStats: last command output as 
2019-03-22 03:15:09 [DEBUG   ] Finished updating ant stats in 0.871 seconds
2019-03-22 03:15:29 [INFO    ] -------------------
2019-03-22 03:15:29 [INFO    ]  LWA board status
2019-03-22 03:15:29 [INFO    ] -------------------
2019-03-22 03:15:29 [INFO    ] DP 1: 2 lwa27
2019-03-22 03:15:29 [INFO    ] DP 1: 3 lwa24
2019-03-22 03:15:29 [INFO    ] DP 1: 4 lwa23
2019-03-22 03:15:29 [INFO    ] DP 1: 5 lwa18
2019-03-22 03:15:29 [INFO    ] DP 1: 6 lwa10
2019-03-22 03:15:29 [INFO    ] DP 1: 7 lwa32
2019-03-22 03:15:29 [INFO    ] DP 1: 8 lwa11
2019-03-22 03:15:29 [INFO    ] DP 1: 9 lwa30
2019-03-22 03:15:29 [INFO    ] DP 1: 10 lwa12
2019-03-22 03:15:29 [INFO    ] DP 1: 11 lwa8
2019-03-22 03:15:29 [INFO    ] DP 1: 12 lwa13
2019-03-22 03:15:29 [INFO    ] DP 1: 13 lwa26
2019-03-22 03:15:29 [INFO    ] DP 1: 14 lwa14
2019-03-22 03:15:29 [INFO    ] DP 1: 16 lwa22
2019-03-22 03:15:29 [INFO    ] DP 1: 17 lwa20
2019-03-22 03:15:29 [INFO    ] DP 1: 18 lwa1
2019-03-22 03:15:29 [INFO    ] DP 1: 19 lwa5
2019-03-22 03:15:29 [INFO    ] DP 1: 20 lwa25
2019-03-22 03:15:29 [INFO    ] DP 1: 21 lwa35
2019-03-22 03:15:29 [INFO    ] DP 1: 22 lwa19
2019-03-22 03:15:29 [INFO    ] DP 1: 23 lwa21
2019-03-22 03:15:29 [INFO    ] DP 1: 24 lwa6
2019-03-22 03:15:29 [INFO    ] DP 1: 25 lwa7
2019-03-22 03:15:29 [INFO    ] DP 1: 26 lwa33
2019-03-22 03:15:29 [INFO    ] DP 1: 27 lwa15
2019-03-22 03:15:29 [INFO    ] DP 1: 28 lwa28
2019-03-22 03:15:29 [INFO    ] DP 2: 1 lwa16
2019-03-22 03:15:29 [INFO    ] DP 2: 15 lwa34
2019-03-22 03:15:29 [INFO    ] Total of 28 boards
2019-03-22 03:15:29 [INFO    ] Total of 260 stands
2019-03-22 03:15:29 [INFO    ] -------------------
2019-03-22 03:15:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9886
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9887
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9888
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9889
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9890
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9891
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9892
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9893
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9894
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9895
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9896
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9897
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9898
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9899
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9900
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9901
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9902
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9903
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9904
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9905
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9906
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9907
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9908
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9909
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9910
2019-03-22 03:15:36 [DEBUG   ] 2019-03-22 03:15:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9911
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9886 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9887 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9888 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9889 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9890 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9891 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9892 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9893 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9894 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9895 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9896 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9897 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9898 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9899 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9900 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9901 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9902 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9903 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9904 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9905 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9906 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9907 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9908 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9909 exited with status 0
2019-03-22 03:15:48 [DEBUG   ] 2019-03-22 03:15:48 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9910 exited with status 0
2019-03-22 03:15:49 [DEBUG   ] 2019-03-22 03:15:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9911 exited with status 0
2019-03-22 03:15:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] spawn_process: at 2019-03-22 03:15:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-03-22 03:15:49 [DEBUG   ] 2019-03-22 03:15:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9938
2019-03-22 03:15:49 [DEBUG   ] 2019-03-22 03:15:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9939
2019-03-22 03:15:54 [DEBUG   ] 2019-03-22 03:15:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9938 exited with status 0
2019-03-22 03:15:54 [DEBUG   ] 2019-03-22 03:15:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9939 exited with status 0
2019-03-22 03:15:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-03-22 03:15:54 [DEBUG   ] spawn_process: at 2019-03-22 03:15:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-03-22 03:15:54 [DEBUG   ] spawn_process: at 2019-03-22 03:15:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-03-22 03:15:54 [INFO    ] Setting Beam 1 xbars
2019-03-22 03:15:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-03-22 03:15:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-03-22 03:15:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-03-22 03:15:54 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-03-22 03:15:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-03-22 03:15:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-03-22 03:15:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-03-22 03:15:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-03-22 03:15:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-03-22 03:15:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-03-22 03:15:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-03-22 03:15:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-03-22 03:15:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-03-22 03:15:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-03-22 03:15:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-03-22 03:15:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-03-22 03:15:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-03-22 03:15:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-03-22 03:15:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-03-22 03:15:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-03-22 03:15:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-03-22 03:15:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-03-22 03:15:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-03-22 03:15:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-03-22 03:15:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-03-22 03:15:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-03-22 03:15:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-03-22 03:15:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-03-22 03:15:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-03-22 03:15:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-03-22 03:15:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-03-22 03:15:58 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-03-22 03:15:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-03-22 03:15:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-03-22 03:15:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-03-22 03:15:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-03-22 03:15:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-03-22 03:15:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-03-22 03:15:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-03-22 03:15:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-03-22 03:15:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-03-22 03:16:00 [INFO    ] Setting Beam 2 xbars
2019-03-22 03:16:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-03-22 03:16:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-03-22 03:16:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-03-22 03:16:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-03-22 03:16:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-03-22 03:16:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-03-22 03:16:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-03-22 03:16:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-03-22 03:16:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-03-22 03:16:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-03-22 03:16:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-03-22 03:16:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-03-22 03:16:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-03-22 03:16:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-03-22 03:16:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-03-22 03:16:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-03-22 03:16:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-03-22 03:16:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-03-22 03:16:02 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-03-22 03:16:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-03-22 03:16:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-03-22 03:16:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-03-22 03:16:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-03-22 03:16:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-03-22 03:16:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-03-22 03:16:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-03-22 03:16:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-03-22 03:16:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-03-22 03:16:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-03-22 03:16:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-03-22 03:16:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-03-22 03:16:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-03-22 03:16:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-03-22 03:16:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-03-22 03:16:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-03-22 03:16:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-03-22 03:16:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-03-22 03:16:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-03-22 03:16:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-03-22 03:16:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-03-22 03:16:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-03-22 03:16:05 [INFO    ] Setting Beam 3 xbars
2019-03-22 03:16:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-03-22 03:16:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-03-22 03:16:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-03-22 03:16:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-03-22 03:16:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-03-22 03:16:06 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-03-22 03:16:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-03-22 03:16:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-03-22 03:16:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-03-22 03:16:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-03-22 03:16:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-03-22 03:16:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-03-22 03:16:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-03-22 03:16:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-03-22 03:16:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-03-22 03:16:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-03-22 03:16:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-03-22 03:16:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-03-22 03:16:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-03-22 03:16:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-03-22 03:16:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-03-22 03:16:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-03-22 03:16:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-03-22 03:16:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-03-22 03:16:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-03-22 03:16:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-03-22 03:16:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-03-22 03:16:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-03-22 03:16:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-03-22 03:16:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-03-22 03:16:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-03-22 03:16:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-03-22 03:16:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-03-22 03:16:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-03-22 03:16:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-03-22 03:16:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-03-22 03:16:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-03-22 03:16:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-03-22 03:16:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-03-22 03:16:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-03-22 03:16:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-03-22 03:16:10 [INFO    ] Setting Beam 4 xbars
2019-03-22 03:16:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-03-22 03:16:11 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-03-22 03:16:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-03-22 03:16:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-03-22 03:16:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-03-22 03:16:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-03-22 03:16:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-03-22 03:16:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-03-22 03:16:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-03-22 03:16:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-03-22 03:16:12 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-03-22 03:16:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-03-22 03:16:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-03-22 03:16:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-03-22 03:16:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-03-22 03:16:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-03-22 03:16:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-03-22 03:16:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-03-22 03:16:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-03-22 03:16:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-03-22 03:16:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-03-22 03:16:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-03-22 03:16:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-03-22 03:16:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-03-22 03:16:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-03-22 03:16:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-03-22 03:16:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-03-22 03:16:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-03-22 03:16:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-03-22 03:16:15 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-03-22 03:16:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-03-22 03:16:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-03-22 03:16:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-03-22 03:16:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-03-22 03:16:16 [INFO    ] All xbars set
2019-03-22 03:16:16 [INFO    ] Setting adder chain routing for all beams
2019-03-22 03:16:21 [INFO    ] Setting beam ids
2019-03-22 03:16:31 [INFO    ] Starting beam delay calibration
2019-03-22 03:16:43 [INFO    ] Beam 1 latency is 5732
2019-03-22 03:16:43 [INFO    ] Beam 2 latency is 5703
2019-03-22 03:16:43 [INFO    ] Beam 3 latency is 5719
2019-03-22 03:16:43 [INFO    ] Beam 4 latency is 5740
2019-03-22 03:16:43 [INFO    ] Stop calibration
2019-03-22 03:16:51 [INFO    ] Beam delay calibration successful
2019-03-22 03:16:51 [INFO    ] Calibration passed
2019-03-22 03:16:51 [DEBUG   ] spawn_process: at 2019-03-22 03:16:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-03-22 03:16:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-03-22 03:16:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-03-22 03:16:51 [DEBUG   ] spawn_process: at 2019-03-22 03:16:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-03-22 03:16:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-03-22 03:16:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-03-22 03:16:51 [DEBUG   ] spawn_process: at 2019-03-22 03:16:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-03-22 03:16:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-03-22 03:16:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-03-22 03:16:51 [DEBUG   ] spawn_process: at 2019-03-22 03:16:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-03-22 03:16:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-03-22 03:16:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-03-22 03:16:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-03-22 03:16:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 295 ms (1553224612.297 s) with PID 11515 and time 1553224613
2019-03-22 03:16:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-03-22 03:16:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 384 ms (1553224612.387 s) with PID 11518 and time 1553224613
2019-03-22 03:16:52 [DEBUG   ] Got command RPT from MCS: ref #98563
2019-03-22 03:16:52 [DEBUG   ] summary = BOOTING
2019-03-22 03:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98563  15 58564 11812731 ABOOTINGBOOTING'
2019-03-22 03:16:53 [DEBUG   ] Finished updating ant stats in 0.861 seconds
2019-03-22 03:16:53 [INFO    ] Started antennas statistics background thread
2019-03-22 03:16:53 [INFO    ] Started board flags background thread
2019-03-22 03:16:53 [INFO    ] Started BAM background thread
2019-03-22 03:16:53 [INFO    ] Finished the INI process (ref. #98560) in 107.837 s
2019-03-22 03:16:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:16:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:16:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:16:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:16:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:16:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:16:54 [DEBUG   ] Finished updating board flags in 1.046 seconds
2019-03-22 03:17:14 [DEBUG   ] Finished updating ant stats in 1.801 seconds
2019-03-22 03:17:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:17:40 [DEBUG   ] Got command RPT from MCS: ref #98569
2019-03-22 03:17:40 [DEBUG   ] summary = ERROR
2019-03-22 03:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98569  13 58564 11860951 A  ERRORERROR'
2019-03-22 03:17:40 [DEBUG   ] Got command RPT from MCS: ref #98570
2019-03-22 03:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98570  77 58564 11860951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:17:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:17:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:17:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:17:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:17:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:17:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:17:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:17:54 [DEBUG   ] Finished updating board flags in 0.996 seconds
2019-03-22 03:18:05 [DEBUG   ] Got command RPT from MCS: ref #98592
2019-03-22 03:18:05 [DEBUG   ] summary = ERROR
2019-03-22 03:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98592  13 58564 11885667 A  ERRORERROR'
2019-03-22 03:18:05 [DEBUG   ] Got command RPT from MCS: ref #98593
2019-03-22 03:18:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98593  77 58564 11885667 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:18:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:18:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:18:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:18:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:18:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:18:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:18:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:18:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:18:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:18:55 [DEBUG   ] Finished updating board flags in 1.850 seconds
2019-03-22 03:19:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:19:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:19:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:19:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:19:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:19:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:19:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:19:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:19:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:19:54 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-03-22 03:20:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 03:20:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:20:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:20:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:20:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:20:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:20:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:20:54 [WARNING ] (13, 1, 'bot')
2019-03-22 03:20:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:20:54 [DEBUG   ] Finished updating board flags in 1.226 seconds
2019-03-22 03:21:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:21:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:21:52 [DEBUG   ] Got command RPT from MCS: ref #98600
2019-03-22 03:21:52 [DEBUG   ] summary = ERROR
2019-03-22 03:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98600  13 58564 12112815 A  ERRORERROR'
2019-03-22 03:21:53 [DEBUG   ] Got command RPT from MCS: ref #98601
2019-03-22 03:21:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98601  77 58564 12113019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:21:53 [DEBUG   ] Got command RPT from MCS: ref #98602
2019-03-22 03:21:53 [DEBUG   ] summary = ERROR
2019-03-22 03:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98602  13 58564 12113211 A  ERRORERROR'
2019-03-22 03:21:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:21:53 [DEBUG   ] Got command RPT from MCS: ref #98603
2019-03-22 03:21:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98603  77 58564 12113415 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:21:53 [DEBUG   ] Got command RPT from MCS: ref #98604
2019-03-22 03:21:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98604  12 58564 12113619 A  ERRORB‘™š'
2019-03-22 03:21:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:21:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:21:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:21:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:21:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:21:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:21:55 [DEBUG   ] Finished updating board flags in 1.772 seconds
2019-03-22 03:22:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 03:22:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:22:40 [DEBUG   ] Got command RPT from MCS: ref #98605
2019-03-22 03:22:40 [DEBUG   ] summary = ERROR
2019-03-22 03:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98605  13 58564 12160955 A  ERRORERROR'
2019-03-22 03:22:40 [DEBUG   ] Got command RPT from MCS: ref #98606
2019-03-22 03:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98606  77 58564 12160955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:22:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:22:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:22:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:22:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:22:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:22:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:22:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:22:55 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-03-22 03:23:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 03:23:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:23:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:23:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:23:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:23:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:23:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:23:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:23:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:23:55 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-03-22 03:24:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:24:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:24:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:24:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:24:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:24:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:24:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:24:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:24:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:24:55 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-03-22 03:25:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:25:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:25:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:25:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:25:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:25:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:25:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:25:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:25:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:25:55 [DEBUG   ] Finished updating board flags in 1.238 seconds
2019-03-22 03:26:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:26:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:26:52 [DEBUG   ] Got command RPT from MCS: ref #98630
2019-03-22 03:26:52 [DEBUG   ] summary = ERROR
2019-03-22 03:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98630  13 58564 12412895 A  ERRORERROR'
2019-03-22 03:26:53 [DEBUG   ] Got command RPT from MCS: ref #98631
2019-03-22 03:26:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98631  77 58564 12413099 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:26:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:26:53 [DEBUG   ] Got command RPT from MCS: ref #98632
2019-03-22 03:26:53 [DEBUG   ] summary = ERROR
2019-03-22 03:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98632  13 58564 12413303 A  ERRORERROR'
2019-03-22 03:26:53 [DEBUG   ] Got command RPT from MCS: ref #98634
2019-03-22 03:26:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98634  77 58564 12413495 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:26:53 [DEBUG   ] Got command RPT from MCS: ref #98635
2019-03-22 03:26:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98635  12 58564 12413699 A  ERRORB‘™š'
2019-03-22 03:26:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:26:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:26:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:26:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:26:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:26:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:26:55 [DEBUG   ] Finished updating board flags in 1.169 seconds
2019-03-22 03:27:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:27:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:27:40 [DEBUG   ] Got command RPT from MCS: ref #98646
2019-03-22 03:27:40 [DEBUG   ] summary = ERROR
2019-03-22 03:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98646  13 58564 12460951 A  ERRORERROR'
2019-03-22 03:27:40 [DEBUG   ] Got command RPT from MCS: ref #98647
2019-03-22 03:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98647  77 58564 12460951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:27:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:27:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:27:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:27:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:27:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:27:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:27:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:27:55 [DEBUG   ] Finished updating board flags in 1.041 seconds
2019-03-22 03:28:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:28:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:28:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:28:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:28:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:28:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:28:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:28:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:28:56 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-03-22 03:29:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:29:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:29:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:29:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:29:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:29:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:29:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:29:56 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-03-22 03:30:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:30:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:30:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:30:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:30:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:30:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:30:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:30:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:30:55 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-03-22 03:31:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:31:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:31:52 [DEBUG   ] Got command RPT from MCS: ref #98669
2019-03-22 03:31:52 [DEBUG   ] summary = ERROR
2019-03-22 03:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98669  13 58564 12712979 A  ERRORERROR'
2019-03-22 03:31:53 [DEBUG   ] Got command RPT from MCS: ref #98670
2019-03-22 03:31:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98670  77 58564 12713187 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:31:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:31:53 [DEBUG   ] Got command RPT from MCS: ref #98671
2019-03-22 03:31:53 [DEBUG   ] summary = ERROR
2019-03-22 03:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98671  13 58564 12713391 A  ERRORERROR'
2019-03-22 03:31:53 [DEBUG   ] Got command RPT from MCS: ref #98672
2019-03-22 03:31:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98672  77 58564 12713583 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:31:53 [DEBUG   ] Got command RPT from MCS: ref #98673
2019-03-22 03:31:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98673  12 58564 12713787 A  ERRORB‘™š'
2019-03-22 03:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:31:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:31:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:31:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:31:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:31:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:31:55 [DEBUG   ] Finished updating board flags in 1.454 seconds
2019-03-22 03:32:13 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 03:32:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 03:32:40 [DEBUG   ] Got command RPT from MCS: ref #98674
2019-03-22 03:32:40 [DEBUG   ] summary = ERROR
2019-03-22 03:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98674  13 58564 12760955 A  ERRORERROR'
2019-03-22 03:32:40 [DEBUG   ] Got command RPT from MCS: ref #98675
2019-03-22 03:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98675  77 58564 12760955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:32:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 03:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:32:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:32:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:32:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:32:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:32:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:32:55 [DEBUG   ] Finished updating board flags in 1.324 seconds
2019-03-22 03:33:14 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 03:33:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 03:33:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:33:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:33:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:33:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:33:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:33:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:33:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:33:55 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-03-22 03:34:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 03:34:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:34:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:34:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:34:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:34:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:34:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:34:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:34:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:34:55 [DEBUG   ] Finished updating board flags in 1.209 seconds
2019-03-22 03:35:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:35:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:35:38 [DEBUG   ] Got command DRX from MCS: ref #98702
2019-03-22 03:35:38 [INFO    ] sending drx command to lwa16
2019-03-22 03:35:38 [DEBUG   ] run_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 0']
2019-03-22 03:35:38 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-22 03:35:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    98702   8 58564 12938015 A  ERROR'
2019-03-22 03:35:38 [DEBUG   ] Got command DRX from MCS: ref #98701
2019-03-22 03:35:38 [INFO    ] sending drx command to lwa34
2019-03-22 03:35:38 [DEBUG   ] run_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2019-03-22 03:35:38 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-22 03:35:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    98701   8 58564 12938019 A  ERROR'
2019-03-22 03:35:38 [DEBUG   ] Got command DRX from MCS: ref #98703
2019-03-22 03:35:38 [INFO    ] sending drx command to lwa34
2019-03-22 03:35:38 [DEBUG   ] run_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2019-03-22 03:35:38 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-22 03:35:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    98703   8 58564 12938023 A  ERROR'
2019-03-22 03:35:38 [DEBUG   ] Got command DRX from MCS: ref #98704
2019-03-22 03:35:38 [INFO    ] sending drx command to lwa16
2019-03-22 03:35:38 [DEBUG   ] run_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 0']
2019-03-22 03:35:38 [DEBUG   ] drx = exited with status True, code 0x00
2019-03-22 03:35:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    98704   8 58564 12938027 A  ERROR'
2019-03-22 03:35:38 [DEBUG   ] Got command BAM from MCS: ref #98705
2019-03-22 03:35:38 [INFO    ] Finished processing BAM request
2019-03-22 03:35:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:35:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98705   8 58564 12938031 A  ERROR'
2019-03-22 03:35:38 [DEBUG   ] Got command BAM from MCS: ref #98706
2019-03-22 03:35:38 [INFO    ] Finished processing BAM request
2019-03-22 03:35:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:35:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98706   8 58564 12938035 A  ERROR'
2019-03-22 03:35:38 [INFO    ] Finished starting DRX
2019-03-22 03:35:38 [INFO    ] Finished starting DRX
2019-03-22 03:35:38 [INFO    ] Finished starting DRX
2019-03-22 03:35:38 [INFO    ] Finished starting DRX
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 03:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 03:35:38 [DEBUG   ] spawn_process: at 2019-03-22 03:35:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 03:35:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 03:35:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 03:35:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:35:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:35:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:35:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:35:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:35:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:35:55 [DEBUG   ] Finished updating board flags in 1.170 seconds
2019-03-22 03:36:14 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 03:36:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:36:37 [DEBUG   ] Got command BAM from MCS: ref #98715
2019-03-22 03:36:37 [INFO    ] Finished processing BAM request
2019-03-22 03:36:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98715   8 58564 12997027 A  ERROR'
2019-03-22 03:36:37 [DEBUG   ] Got command BAM from MCS: ref #98716
2019-03-22 03:36:37 [INFO    ] Finished processing BAM request
2019-03-22 03:36:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98716   8 58564 12997031 A  ERROR'
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 03:36:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 03:36:37 [DEBUG   ] spawn_process: at 2019-03-22 03:36:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 03:36:53 [DEBUG   ] Got command RPT from MCS: ref #98719
2019-03-22 03:36:53 [DEBUG   ] summary = ERROR
2019-03-22 03:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98719  13 58564 13013067 A  ERRORERROR'
2019-03-22 03:36:53 [DEBUG   ] Got command RPT from MCS: ref #98720
2019-03-22 03:36:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98720  77 58564 13013271 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:36:53 [DEBUG   ] Got command RPT from MCS: ref #98721
2019-03-22 03:36:53 [DEBUG   ] summary = ERROR
2019-03-22 03:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98721  13 58564 13013473 A  ERRORERROR'
2019-03-22 03:36:53 [DEBUG   ] Got command RPT from MCS: ref #98723
2019-03-22 03:36:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98723  77 58564 13013667 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:36:53 [DEBUG   ] Got command RPT from MCS: ref #98725
2019-03-22 03:36:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98725  12 58564 13013871 A  ERRORB—™š'
2019-03-22 03:36:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:36:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 03:36:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:36:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:36:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:36:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:36:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:36:55 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-03-22 03:37:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 03:37:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:37:36 [DEBUG   ] Got command BAM from MCS: ref #98729
2019-03-22 03:37:36 [INFO    ] Finished processing BAM request
2019-03-22 03:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98729   8 58564 13056027 A  ERROR'
2019-03-22 03:37:36 [DEBUG   ] Got command BAM from MCS: ref #98730
2019-03-22 03:37:36 [INFO    ] Finished processing BAM request
2019-03-22 03:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98730   8 58564 13056031 A  ERROR'
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 03:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 03:37:36 [DEBUG   ] spawn_process: at 2019-03-22 03:37:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 03:37:40 [DEBUG   ] Got command RPT from MCS: ref #98731
2019-03-22 03:37:40 [DEBUG   ] summary = ERROR
2019-03-22 03:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98731  13 58564 13060955 A  ERRORERROR'
2019-03-22 03:37:40 [DEBUG   ] Got command RPT from MCS: ref #98732
2019-03-22 03:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98732  77 58564 13060955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:37:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:37:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:37:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 03:37:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:37:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:37:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:37:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:37:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:37:55 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-03-22 03:38:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:38:34 [DEBUG   ] Got command BAM from MCS: ref #98749
2019-03-22 03:38:34 [INFO    ] Finished processing BAM request
2019-03-22 03:38:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98749   8 58564 13114027 A  ERROR'
2019-03-22 03:38:34 [DEBUG   ] Got command BAM from MCS: ref #98748
2019-03-22 03:38:34 [INFO    ] Finished processing BAM request
2019-03-22 03:38:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98748   8 58564 13114031 A  ERROR'
2019-03-22 03:38:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 03:38:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 03:38:34 [DEBUG   ] spawn_process: at 2019-03-22 03:38:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 03:38:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:38:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:38:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 03:38:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:38:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:38:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:38:55 [WARNING ] (13, 1, 'bot')
2019-03-22 03:38:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:38:55 [DEBUG   ] Finished updating board flags in 0.964 seconds
2019-03-22 03:39:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 03:39:32 [DEBUG   ] Got command BAM from MCS: ref #98757
2019-03-22 03:39:32 [INFO    ] Finished processing BAM request
2019-03-22 03:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98757   8 58564 13172035 A  ERROR'
2019-03-22 03:39:32 [DEBUG   ] Got command BAM from MCS: ref #98756
2019-03-22 03:39:32 [INFO    ] Finished processing BAM request
2019-03-22 03:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98756   8 58564 13172039 A  ERROR'
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 03:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 03:39:32 [DEBUG   ] spawn_process: at 2019-03-22 03:39:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 03:39:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:39:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:39:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 03:39:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 03:39:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-03-22 03:39:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:39:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:39:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:39:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:39:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:39:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:39:56 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-03-22 03:40:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:40:30 [DEBUG   ] Got command BAM from MCS: ref #98759
2019-03-22 03:40:30 [INFO    ] Finished processing BAM request
2019-03-22 03:40:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98759   8 58564 13230027 A  ERROR'
2019-03-22 03:40:30 [DEBUG   ] Got command BAM from MCS: ref #98758
2019-03-22 03:40:30 [INFO    ] Finished processing BAM request
2019-03-22 03:40:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98758   8 58564 13230031 A  ERROR'
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 03:40:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 03:40:30 [DEBUG   ] spawn_process: at 2019-03-22 03:40:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 03:40:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:40:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:40:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:40:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 03:40:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-22 03:40:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:40:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:40:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:40:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:40:56 [DEBUG   ] Finished updating board flags in 1.280 seconds
2019-03-22 03:41:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:41:27 [DEBUG   ] Got command BAM from MCS: ref #98760
2019-03-22 03:41:27 [INFO    ] Finished processing BAM request
2019-03-22 03:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98760   8 58564 13287035 A  ERROR'
2019-03-22 03:41:27 [DEBUG   ] Got command BAM from MCS: ref #98761
2019-03-22 03:41:27 [INFO    ] Finished processing BAM request
2019-03-22 03:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98761   8 58564 13287039 A  ERROR'
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 03:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 03:41:27 [DEBUG   ] spawn_process: at 2019-03-22 03:41:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 03:41:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:41:53 [DEBUG   ] Got command RPT from MCS: ref #98762
2019-03-22 03:41:53 [DEBUG   ] summary = ERROR
2019-03-22 03:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98762  13 58564 13313155 A  ERRORERROR'
2019-03-22 03:41:53 [DEBUG   ] Got command RPT from MCS: ref #98763
2019-03-22 03:41:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98763  77 58564 13313359 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:41:53 [DEBUG   ] Got command RPT from MCS: ref #98764
2019-03-22 03:41:53 [DEBUG   ] summary = ERROR
2019-03-22 03:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98764  13 58564 13313551 A  ERRORERROR'
2019-03-22 03:41:53 [DEBUG   ] Got command RPT from MCS: ref #98765
2019-03-22 03:41:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98765  77 58564 13313755 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:41:53 [DEBUG   ] Got command RPT from MCS: ref #98766
2019-03-22 03:41:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98766  12 58564 13313959 A  ERRORBžff'
2019-03-22 03:41:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:41:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:41:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:41:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:41:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:41:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:41:56 [DEBUG   ] Finished updating board flags in 1.116 seconds
2019-03-22 03:42:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:42:24 [DEBUG   ] Got command BAM from MCS: ref #98773
2019-03-22 03:42:24 [INFO    ] Finished processing BAM request
2019-03-22 03:42:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98773   8 58564 13344031 A  ERROR'
2019-03-22 03:42:24 [DEBUG   ] Got command BAM from MCS: ref #98774
2019-03-22 03:42:24 [INFO    ] Finished processing BAM request
2019-03-22 03:42:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98774   8 58564 13344035 A  ERROR'
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 03:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 03:42:24 [DEBUG   ] spawn_process: at 2019-03-22 03:42:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 03:42:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:42:40 [DEBUG   ] Got command RPT from MCS: ref #98775
2019-03-22 03:42:40 [DEBUG   ] summary = ERROR
2019-03-22 03:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98775  13 58564 13360955 A  ERRORERROR'
2019-03-22 03:42:40 [DEBUG   ] Got command RPT from MCS: ref #98776
2019-03-22 03:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98776  77 58564 13360955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:42:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:42:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:42:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:42:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:42:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:42:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:42:56 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-03-22 03:43:14 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 03:43:21 [DEBUG   ] Got command BAM from MCS: ref #98793
2019-03-22 03:43:21 [INFO    ] Finished processing BAM request
2019-03-22 03:43:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98793   8 58564 13401035 A  ERROR'
2019-03-22 03:43:21 [DEBUG   ] Got command BAM from MCS: ref #98792
2019-03-22 03:43:21 [INFO    ] Finished processing BAM request
2019-03-22 03:43:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98792   8 58564 13401039 A  ERROR'
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 03:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 03:43:21 [DEBUG   ] spawn_process: at 2019-03-22 03:43:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 03:43:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:43:54 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 03:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:43:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 03:43:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:43:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:43:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:43:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:43:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:43:57 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-03-22 03:44:15 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 03:44:18 [DEBUG   ] Got command BAM from MCS: ref #98795
2019-03-22 03:44:18 [INFO    ] Finished processing BAM request
2019-03-22 03:44:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98795   8 58564 13458027 A  ERROR'
2019-03-22 03:44:18 [DEBUG   ] Got command BAM from MCS: ref #98794
2019-03-22 03:44:18 [INFO    ] Finished processing BAM request
2019-03-22 03:44:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98794   8 58564 13458031 A  ERROR'
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 03:44:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 03:44:18 [DEBUG   ] spawn_process: at 2019-03-22 03:44:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 03:44:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:44:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 03:44:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:44:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:44:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:44:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:44:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:44:56 [DEBUG   ] Finished updating board flags in 1.229 seconds
2019-03-22 03:45:15 [DEBUG   ] Got command BAM from MCS: ref #98803
2019-03-22 03:45:15 [INFO    ] Finished processing BAM request
2019-03-22 03:45:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98803   8 58564 13515035 A  ERROR'
2019-03-22 03:45:15 [DEBUG   ] Got command BAM from MCS: ref #98802
2019-03-22 03:45:15 [INFO    ] Finished processing BAM request
2019-03-22 03:45:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98802   8 58564 13515039 A  ERROR'
2019-03-22 03:45:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 03:45:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 03:45:15 [DEBUG   ] spawn_process: at 2019-03-22 03:45:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 03:45:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:45:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:45:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 03:45:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-22 03:45:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:45:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:45:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:45:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:45:56 [DEBUG   ] Finished updating board flags in 1.219 seconds
2019-03-22 03:46:11 [DEBUG   ] Got command BAM from MCS: ref #98805
2019-03-22 03:46:11 [INFO    ] Finished processing BAM request
2019-03-22 03:46:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98805   8 58564 13571035 A  ERROR'
2019-03-22 03:46:11 [DEBUG   ] Got command BAM from MCS: ref #98804
2019-03-22 03:46:11 [INFO    ] Finished processing BAM request
2019-03-22 03:46:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98804   8 58564 13571039 A  ERROR'
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 03:46:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 03:46:11 [DEBUG   ] spawn_process: at 2019-03-22 03:46:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 03:46:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 03:46:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:46:53 [DEBUG   ] Got command RPT from MCS: ref #98808
2019-03-22 03:46:53 [DEBUG   ] summary = ERROR
2019-03-22 03:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98808  13 58564 13613243 A  ERRORERROR'
2019-03-22 03:46:53 [DEBUG   ] Got command RPT from MCS: ref #98809
2019-03-22 03:46:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98809  77 58564 13613435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:46:53 [DEBUG   ] Got command RPT from MCS: ref #98810
2019-03-22 03:46:53 [DEBUG   ] summary = ERROR
2019-03-22 03:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98810  13 58564 13613639 A  ERRORERROR'
2019-03-22 03:46:53 [DEBUG   ] Got command RPT from MCS: ref #98812
2019-03-22 03:46:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98812  77 58564 13613843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:46:54 [DEBUG   ] Got command RPT from MCS: ref #98813
2019-03-22 03:46:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98813  12 58564 13614047 A  ERRORBžff'
2019-03-22 03:46:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 03:46:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 03:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:46:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:46:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:46:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:46:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:46:56 [DEBUG   ] Finished updating board flags in 1.261 seconds
2019-03-22 03:47:07 [DEBUG   ] Got command BAM from MCS: ref #98818
2019-03-22 03:47:07 [INFO    ] Finished processing BAM request
2019-03-22 03:47:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:47:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98818   8 58564 13627031 A  ERROR'
2019-03-22 03:47:07 [DEBUG   ] Got command BAM from MCS: ref #98819
2019-03-22 03:47:07 [INFO    ] Finished processing BAM request
2019-03-22 03:47:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:47:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98819   8 58564 13627035 A  ERROR'
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 03:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 03:47:07 [DEBUG   ] spawn_process: at 2019-03-22 03:47:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 03:47:15 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 03:47:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:47:40 [DEBUG   ] Got command RPT from MCS: ref #98820
2019-03-22 03:47:40 [DEBUG   ] summary = ERROR
2019-03-22 03:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98820  13 58564 13660951 A  ERRORERROR'
2019-03-22 03:47:40 [DEBUG   ] Got command RPT from MCS: ref #98821
2019-03-22 03:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98821  77 58564 13660951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:47:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:47:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 03:47:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 03:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:47:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:47:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:47:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:47:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:47:56 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-03-22 03:48:03 [DEBUG   ] Got command BAM from MCS: ref #98844
2019-03-22 03:48:03 [INFO    ] Finished processing BAM request
2019-03-22 03:48:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:48:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98844   8 58564 13683035 A  ERROR'
2019-03-22 03:48:03 [DEBUG   ] Got command BAM from MCS: ref #98843
2019-03-22 03:48:03 [INFO    ] Finished processing BAM request
2019-03-22 03:48:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:48:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98843   8 58564 13683039 A  ERROR'
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 03:48:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 03:48:03 [DEBUG   ] spawn_process: at 2019-03-22 03:48:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 03:48:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:48:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:48:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:48:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:48:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:48:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:48:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:48:56 [DEBUG   ] Finished updating board flags in 1.128 seconds
2019-03-22 03:48:59 [DEBUG   ] Got command BAM from MCS: ref #98845
2019-03-22 03:48:59 [INFO    ] Finished processing BAM request
2019-03-22 03:48:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98845   8 58564 13739035 A  ERROR'
2019-03-22 03:48:59 [DEBUG   ] Got command BAM from MCS: ref #98846
2019-03-22 03:48:59 [INFO    ] Finished processing BAM request
2019-03-22 03:48:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98846   8 58564 13739039 A  ERROR'
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 03:48:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 03:48:59 [DEBUG   ] spawn_process: at 2019-03-22 03:48:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 03:49:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:49:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:49:55 [DEBUG   ] Got command BAM from MCS: ref #98847
2019-03-22 03:49:55 [INFO    ] Finished processing BAM request
2019-03-22 03:49:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98847   8 58564 13795035 A  ERROR'
2019-03-22 03:49:55 [DEBUG   ] Got command BAM from MCS: ref #98848
2019-03-22 03:49:55 [INFO    ] Finished processing BAM request
2019-03-22 03:49:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98848   8 58564 13795039 A  ERROR'
2019-03-22 03:49:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 03:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 03:49:55 [DEBUG   ] spawn_process: at 2019-03-22 03:49:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 03:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-03-22 03:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:49:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:49:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:49:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:49:56 [WARNING ] (13, 1, 'bot')
2019-03-22 03:49:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:49:56 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-03-22 03:50:15 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 03:50:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:50:50 [DEBUG   ] Got command BAM from MCS: ref #98849
2019-03-22 03:50:50 [INFO    ] Finished processing BAM request
2019-03-22 03:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98849   8 58564 13850035 A  ERROR'
2019-03-22 03:50:50 [DEBUG   ] Got command BAM from MCS: ref #98850
2019-03-22 03:50:50 [INFO    ] Finished processing BAM request
2019-03-22 03:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98850   8 58564 13850039 A  ERROR'
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 03:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 03:50:50 [DEBUG   ] spawn_process: at 2019-03-22 03:50:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 03:50:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:50:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 03:50:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:50:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:50:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:50:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:50:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:50:57 [DEBUG   ] Finished updating board flags in 1.550 seconds
2019-03-22 03:51:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:51:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 03:51:45 [DEBUG   ] Got command BAM from MCS: ref #98858
2019-03-22 03:51:45 [INFO    ] Finished processing BAM request
2019-03-22 03:51:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98858   8 58564 13905027 A  ERROR'
2019-03-22 03:51:45 [DEBUG   ] Got command BAM from MCS: ref #98857
2019-03-22 03:51:45 [INFO    ] Finished processing BAM request
2019-03-22 03:51:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98857   8 58564 13905031 A  ERROR'
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 03:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 03:51:45 [DEBUG   ] spawn_process: at 2019-03-22 03:51:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 03:51:53 [DEBUG   ] Got command RPT from MCS: ref #98859
2019-03-22 03:51:53 [DEBUG   ] summary = ERROR
2019-03-22 03:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98859  13 58564 13913323 A  ERRORERROR'
2019-03-22 03:51:53 [DEBUG   ] Got command RPT from MCS: ref #98860
2019-03-22 03:51:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98860  77 58564 13913527 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:51:53 [DEBUG   ] Got command RPT from MCS: ref #98861
2019-03-22 03:51:53 [DEBUG   ] summary = ERROR
2019-03-22 03:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98861  13 58564 13913731 A  ERRORERROR'
2019-03-22 03:51:53 [DEBUG   ] Got command RPT from MCS: ref #98862
2019-03-22 03:51:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98862  77 58564 13913923 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:51:54 [DEBUG   ] Got command RPT from MCS: ref #98863
2019-03-22 03:51:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98863  12 58564 13914127 A  ERRORBžff'
2019-03-22 03:51:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 03:51:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 03:51:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:51:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:51:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:51:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:51:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:51:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:51:57 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-03-22 03:52:15 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-22 03:52:35 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:52:40 [DEBUG   ] Got command BAM from MCS: ref #98864
2019-03-22 03:52:40 [INFO    ] Finished processing BAM request
2019-03-22 03:52:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98864   8 58564 13960035 A  ERROR'
2019-03-22 03:52:40 [DEBUG   ] Got command BAM from MCS: ref #98865
2019-03-22 03:52:40 [INFO    ] Finished processing BAM request
2019-03-22 03:52:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98865   8 58564 13960039 A  ERROR'
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 03:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 03:52:40 [DEBUG   ] spawn_process: at 2019-03-22 03:52:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 03:52:40 [DEBUG   ] Got command RPT from MCS: ref #98866
2019-03-22 03:52:40 [DEBUG   ] summary = ERROR
2019-03-22 03:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98866  13 58564 13960963 A  ERRORERROR'
2019-03-22 03:52:40 [DEBUG   ] Got command RPT from MCS: ref #98867
2019-03-22 03:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98867  77 58564 13960963 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:52:55 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-03-22 03:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 03:52:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:52:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:52:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:52:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:52:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:52:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:52:57 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-03-22 03:53:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 03:53:35 [DEBUG   ] Got command BAM from MCS: ref #98884
2019-03-22 03:53:35 [INFO    ] Finished processing BAM request
2019-03-22 03:53:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98884   8 58564 14015027 A  ERROR'
2019-03-22 03:53:35 [DEBUG   ] Got command BAM from MCS: ref #98883
2019-03-22 03:53:35 [INFO    ] Finished processing BAM request
2019-03-22 03:53:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98883   8 58564 14015031 A  ERROR'
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 03:53:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 03:53:35 [DEBUG   ] spawn_process: at 2019-03-22 03:53:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 03:53:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 03:53:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 03:53:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 03:53:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:53:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 03:53:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:53:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:53:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:53:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:53:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:53:57 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-03-22 03:54:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 03:54:30 [DEBUG   ] Got command BAM from MCS: ref #98892
2019-03-22 03:54:30 [INFO    ] Finished processing BAM request
2019-03-22 03:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98892   8 58564 14070027 A  ERROR'
2019-03-22 03:54:30 [DEBUG   ] Got command BAM from MCS: ref #98891
2019-03-22 03:54:30 [INFO    ] Finished processing BAM request
2019-03-22 03:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98891   8 58564 14070031 A  ERROR'
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 03:54:30 [DEBUG   ] spawn_process: at 2019-03-22 03:54:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 03:54:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 03:54:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 03:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 03:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-22 03:54:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:54:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:54:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:54:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:54:57 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-03-22 03:55:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 03:55:25 [DEBUG   ] Got command BAM from MCS: ref #98893
2019-03-22 03:55:25 [INFO    ] Finished processing BAM request
2019-03-22 03:55:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98893   8 58564 14125027 A  ERROR'
2019-03-22 03:55:25 [DEBUG   ] Got command BAM from MCS: ref #98894
2019-03-22 03:55:25 [INFO    ] Finished processing BAM request
2019-03-22 03:55:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98894   8 58564 14125031 A  ERROR'
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 03:55:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 03:55:25 [DEBUG   ] spawn_process: at 2019-03-22 03:55:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 03:55:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 03:55:56 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:55:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 03:55:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:55:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:55:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:55:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:55:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:55:57 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-03-22 03:56:16 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 03:56:19 [DEBUG   ] Got command BAM from MCS: ref #98896
2019-03-22 03:56:19 [INFO    ] Finished processing BAM request
2019-03-22 03:56:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98896   8 58564 14179031 A  ERROR'
2019-03-22 03:56:19 [DEBUG   ] Got command BAM from MCS: ref #98895
2019-03-22 03:56:19 [INFO    ] Finished processing BAM request
2019-03-22 03:56:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:56:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98895   8 58564 14179035 A  ERROR'
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 03:56:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 03:56:19 [DEBUG   ] spawn_process: at 2019-03-22 03:56:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 03:56:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 03:56:53 [DEBUG   ] Got command RPT from MCS: ref #98899
2019-03-22 03:56:53 [DEBUG   ] summary = ERROR
2019-03-22 03:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98899  13 58564 14213415 A  ERRORERROR'
2019-03-22 03:56:53 [DEBUG   ] Got command RPT from MCS: ref #98900
2019-03-22 03:56:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98900  77 58564 14213607 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:56:53 [DEBUG   ] Got command RPT from MCS: ref #98901
2019-03-22 03:56:53 [DEBUG   ] summary = ERROR
2019-03-22 03:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98901  13 58564 14213811 A  ERRORERROR'
2019-03-22 03:56:54 [DEBUG   ] Got command RPT from MCS: ref #98903
2019-03-22 03:56:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98903  77 58564 14214015 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:56:54 [DEBUG   ] Got command RPT from MCS: ref #98904
2019-03-22 03:56:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 03:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98904  12 58564 14214219 A  ERRORB�ff'
2019-03-22 03:56:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 03:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:56:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-22 03:56:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:56:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:56:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:56:57 [WARNING ] (13, 1, 'bot')
2019-03-22 03:56:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:56:57 [DEBUG   ] Finished updating board flags in 0.997 seconds
2019-03-22 03:57:13 [DEBUG   ] Got command BAM from MCS: ref #98916
2019-03-22 03:57:13 [INFO    ] Finished processing BAM request
2019-03-22 03:57:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98916   8 58564 14233031 A  ERROR'
2019-03-22 03:57:13 [DEBUG   ] Got command BAM from MCS: ref #98915
2019-03-22 03:57:13 [INFO    ] Finished processing BAM request
2019-03-22 03:57:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:57:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98915   8 58564 14233035 A  ERROR'
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 03:57:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 03:57:13 [DEBUG   ] spawn_process: at 2019-03-22 03:57:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 03:57:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:57:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 03:57:40 [DEBUG   ] Got command RPT from MCS: ref #98917
2019-03-22 03:57:40 [DEBUG   ] summary = ERROR
2019-03-22 03:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98917  13 58564 14260963 A  ERRORERROR'
2019-03-22 03:57:40 [DEBUG   ] Got command RPT from MCS: ref #98918
2019-03-22 03:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 03:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98918  77 58564 14260963 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 03:57:56 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 03:57:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 03:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:57:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:57:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:57:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:57:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:57:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:57:58 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-03-22 03:58:07 [DEBUG   ] Got command BAM from MCS: ref #98935
2019-03-22 03:58:07 [INFO    ] Finished processing BAM request
2019-03-22 03:58:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98935   8 58564 14287035 A  ERROR'
2019-03-22 03:58:07 [DEBUG   ] Got command BAM from MCS: ref #98934
2019-03-22 03:58:07 [INFO    ] Finished processing BAM request
2019-03-22 03:58:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98934   8 58564 14287039 A  ERROR'
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 03:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 03:58:07 [DEBUG   ] spawn_process: at 2019-03-22 03:58:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 03:58:16 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 03:58:36 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 03:58:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 03:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:58:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 03:58:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:58:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:58:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:58:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:58:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:58:58 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-03-22 03:59:01 [DEBUG   ] Got command BAM from MCS: ref #98936
2019-03-22 03:59:01 [INFO    ] Finished processing BAM request
2019-03-22 03:59:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98936   8 58564 14341031 A  ERROR'
2019-03-22 03:59:01 [DEBUG   ] Got command BAM from MCS: ref #98937
2019-03-22 03:59:01 [INFO    ] Finished processing BAM request
2019-03-22 03:59:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98937   8 58564 14341035 A  ERROR'
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 03:59:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 03:59:01 [DEBUG   ] spawn_process: at 2019-03-22 03:59:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 03:59:16 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-03-22 03:59:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 03:59:55 [DEBUG   ] Got command BAM from MCS: ref #98938
2019-03-22 03:59:55 [INFO    ] Finished processing BAM request
2019-03-22 03:59:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98938   8 58564 14395031 A  ERROR'
2019-03-22 03:59:55 [DEBUG   ] Got command BAM from MCS: ref #98939
2019-03-22 03:59:55 [INFO    ] Finished processing BAM request
2019-03-22 03:59:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 03:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98939   8 58564 14395035 A  ERROR'
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 03:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 03:59:55 [DEBUG   ] spawn_process: at 2019-03-22 03:59:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 03:59:57 [DEBUG   ] Finished updating ant stats in 1.227 seconds
2019-03-22 03:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 03:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 03:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-22 03:59:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:59:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:59:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:59:58 [WARNING ] (13, 1, 'bot')
2019-03-22 03:59:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 03:59:58 [DEBUG   ] Finished updating board flags in 1.771 seconds
2019-03-22 04:00:17 [DEBUG   ] Finished updating ant stats in 1.173 seconds
2019-03-22 04:00:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:00:49 [DEBUG   ] Got command BAM from MCS: ref #98947
2019-03-22 04:00:49 [INFO    ] Finished processing BAM request
2019-03-22 04:00:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98947   8 58564 14449031 A  ERROR'
2019-03-22 04:00:49 [DEBUG   ] Got command BAM from MCS: ref #98946
2019-03-22 04:00:49 [INFO    ] Finished processing BAM request
2019-03-22 04:00:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98946   8 58564 14449035 A  ERROR'
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:00:49 [DEBUG   ] spawn_process: at 2019-03-22 04:00:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:00:57 [DEBUG   ] Finished updating ant stats in 1.030 seconds
2019-03-22 04:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:00:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:00:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:00:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:00:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:00:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:00:58 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-03-22 04:01:17 [DEBUG   ] Finished updating ant stats in 0.973 seconds
2019-03-22 04:01:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:01:42 [DEBUG   ] Got command BAM from MCS: ref #98949
2019-03-22 04:01:42 [INFO    ] Finished processing BAM request
2019-03-22 04:01:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98949   8 58564 14502031 A  ERROR'
2019-03-22 04:01:42 [DEBUG   ] Got command BAM from MCS: ref #98948
2019-03-22 04:01:42 [INFO    ] Finished processing BAM request
2019-03-22 04:01:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98948   8 58564 14502035 A  ERROR'
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:01:42 [DEBUG   ] spawn_process: at 2019-03-22 04:01:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:01:53 [DEBUG   ] Got command RPT from MCS: ref #98950
2019-03-22 04:01:53 [DEBUG   ] summary = ERROR
2019-03-22 04:01:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98950  13 58564 14513495 A  ERRORERROR'
2019-03-22 04:01:53 [DEBUG   ] Got command RPT from MCS: ref #98951
2019-03-22 04:01:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:01:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98951  77 58564 14513699 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:01:53 [DEBUG   ] Got command RPT from MCS: ref #98952
2019-03-22 04:01:53 [DEBUG   ] summary = ERROR
2019-03-22 04:01:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98952  13 58564 14513891 A  ERRORERROR'
2019-03-22 04:01:54 [DEBUG   ] Got command RPT from MCS: ref #98953
2019-03-22 04:01:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98953  77 58564 14514095 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:01:54 [DEBUG   ] Got command RPT from MCS: ref #98954
2019-03-22 04:01:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98954  12 58564 14514299 A  ERRORB�ff'
2019-03-22 04:01:57 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2019-03-22 04:01:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-03-22 04:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:01:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:01:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:01:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:01:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:01:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:01:58 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-03-22 04:02:17 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2019-03-22 04:02:35 [DEBUG   ] Got command BAM from MCS: ref #98955
2019-03-22 04:02:35 [INFO    ] Finished processing BAM request
2019-03-22 04:02:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98955   8 58564 14555031 A  ERROR'
2019-03-22 04:02:35 [DEBUG   ] Got command BAM from MCS: ref #98956
2019-03-22 04:02:35 [INFO    ] Finished processing BAM request
2019-03-22 04:02:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98956   8 58564 14555035 A  ERROR'
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:02:35 [DEBUG   ] spawn_process: at 2019-03-22 04:02:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:02:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 04:02:40 [DEBUG   ] Got command RPT from MCS: ref #98957
2019-03-22 04:02:40 [DEBUG   ] summary = ERROR
2019-03-22 04:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98957  13 58564 14560955 A  ERRORERROR'
2019-03-22 04:02:40 [DEBUG   ] Got command RPT from MCS: ref #98958
2019-03-22 04:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98958  77 58564 14560955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:02:57 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2019-03-22 04:02:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:02:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:02:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:02:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:02:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:02:58 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-03-22 04:03:17 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2019-03-22 04:03:28 [DEBUG   ] Got command BAM from MCS: ref #98981
2019-03-22 04:03:28 [INFO    ] Finished processing BAM request
2019-03-22 04:03:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98981   8 58564 14608035 A  ERROR'
2019-03-22 04:03:28 [DEBUG   ] Got command BAM from MCS: ref #98980
2019-03-22 04:03:28 [INFO    ] Finished processing BAM request
2019-03-22 04:03:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98980   8 58564 14608039 A  ERROR'
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:03:28 [DEBUG   ] spawn_process: at 2019-03-22 04:03:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:03:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 04:03:57 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2019-03-22 04:03:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:03:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:03:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:03:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:03:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:03:58 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-03-22 04:04:17 [DEBUG   ] Finished updating ant stats in 0.373 seconds
2019-03-22 04:04:21 [DEBUG   ] Got command BAM from MCS: ref #98983
2019-03-22 04:04:21 [INFO    ] Finished processing BAM request
2019-03-22 04:04:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98983   8 58564 14661027 A  ERROR'
2019-03-22 04:04:21 [DEBUG   ] Got command BAM from MCS: ref #98982
2019-03-22 04:04:21 [INFO    ] Finished processing BAM request
2019-03-22 04:04:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98982   8 58564 14661031 A  ERROR'
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:04:21 [DEBUG   ] spawn_process: at 2019-03-22 04:04:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:04:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:04:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:04:58 [DEBUG   ] Finished updating ant stats in 1.223 seconds
2019-03-22 04:04:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:04:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:04:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:04:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:04:58 [DEBUG   ] Finished updating board flags in 1.472 seconds
2019-03-22 04:05:14 [DEBUG   ] Got command BAM from MCS: ref #98985
2019-03-22 04:05:14 [INFO    ] Finished processing BAM request
2019-03-22 04:05:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98985   8 58564 14714027 A  ERROR'
2019-03-22 04:05:14 [DEBUG   ] Got command BAM from MCS: ref #98984
2019-03-22 04:05:14 [INFO    ] Finished processing BAM request
2019-03-22 04:05:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98984   8 58564 14714031 A  ERROR'
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:05:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:05:14 [DEBUG   ] spawn_process: at 2019-03-22 04:05:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:05:18 [DEBUG   ] Finished updating ant stats in 1.177 seconds
2019-03-22 04:05:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:05:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:05:58 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2019-03-22 04:05:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:05:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:05:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:05:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:05:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:05:58 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-03-22 04:06:07 [DEBUG   ] Got command BAM from MCS: ref #98993
2019-03-22 04:06:07 [INFO    ] Finished processing BAM request
2019-03-22 04:06:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:06:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98993   8 58564 14767027 A  ERROR'
2019-03-22 04:06:07 [DEBUG   ] Got command BAM from MCS: ref #98992
2019-03-22 04:06:07 [INFO    ] Finished processing BAM request
2019-03-22 04:06:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:06:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    98992   8 58564 14767031 A  ERROR'
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:06:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:06:07 [DEBUG   ] spawn_process: at 2019-03-22 04:06:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:06:18 [DEBUG   ] Finished updating ant stats in 0.973 seconds
2019-03-22 04:06:39 [DEBUG   ] Finished updating ant stats in 1.793 seconds
2019-03-22 04:06:53 [DEBUG   ] Got command RPT from MCS: ref #98996
2019-03-22 04:06:53 [DEBUG   ] summary = ERROR
2019-03-22 04:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98996  13 58564 14813583 A  ERRORERROR'
2019-03-22 04:06:53 [DEBUG   ] Got command RPT from MCS: ref #98997
2019-03-22 04:06:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98997  77 58564 14813775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:06:53 [DEBUG   ] Got command RPT from MCS: ref #98998
2019-03-22 04:06:53 [DEBUG   ] summary = ERROR
2019-03-22 04:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98998  13 58564 14813979 A  ERRORERROR'
2019-03-22 04:06:54 [DEBUG   ] Got command RPT from MCS: ref #98999
2019-03-22 04:06:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    98999  77 58564 14814183 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:06:54 [DEBUG   ] Got command RPT from MCS: ref #99001
2019-03-22 04:06:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99001  12 58564 14814375 A  ERRORB�ff'
2019-03-22 04:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:06:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:06:58 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2019-03-22 04:06:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:06:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:06:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:06:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:06:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:06:58 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-03-22 04:07:00 [DEBUG   ] Got command BAM from MCS: ref #99007
2019-03-22 04:07:00 [INFO    ] Finished processing BAM request
2019-03-22 04:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99007   8 58564 14820035 A  ERROR'
2019-03-22 04:07:00 [DEBUG   ] Got command BAM from MCS: ref #99006
2019-03-22 04:07:00 [INFO    ] Finished processing BAM request
2019-03-22 04:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99006   8 58564 14820039 A  ERROR'
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:07:00 [DEBUG   ] spawn_process: at 2019-03-22 04:07:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:07:18 [DEBUG   ] Finished updating ant stats in 0.577 seconds
2019-03-22 04:07:38 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:07:40 [DEBUG   ] Got command RPT from MCS: ref #99008
2019-03-22 04:07:40 [DEBUG   ] summary = ERROR
2019-03-22 04:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99008  13 58564 14860963 A  ERRORERROR'
2019-03-22 04:07:40 [DEBUG   ] Got command RPT from MCS: ref #99009
2019-03-22 04:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99009  77 58564 14860963 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:07:53 [DEBUG   ] Got command BAM from MCS: ref #99026
2019-03-22 04:07:53 [INFO    ] Finished processing BAM request
2019-03-22 04:07:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:07:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99026   8 58564 14873027 A  ERROR'
2019-03-22 04:07:53 [DEBUG   ] Got command BAM from MCS: ref #99025
2019-03-22 04:07:53 [INFO    ] Finished processing BAM request
2019-03-22 04:07:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:07:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99025   8 58564 14873031 A  ERROR'
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:07:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:07:53 [DEBUG   ] spawn_process: at 2019-03-22 04:07:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:07:58 [DEBUG   ] Finished updating ant stats in 0.427 seconds
2019-03-22 04:07:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:07:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:07:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:07:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:07:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:07:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:07:58 [DEBUG   ] Finished updating board flags in 1.200 seconds
2019-03-22 04:08:18 [DEBUG   ] Finished updating ant stats in 0.377 seconds
2019-03-22 04:08:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:08:46 [DEBUG   ] Got command BAM from MCS: ref #99027
2019-03-22 04:08:46 [INFO    ] Finished processing BAM request
2019-03-22 04:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99027   8 58564 14926035 A  ERROR'
2019-03-22 04:08:46 [DEBUG   ] Got command BAM from MCS: ref #99028
2019-03-22 04:08:46 [INFO    ] Finished processing BAM request
2019-03-22 04:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99028   8 58564 14926039 A  ERROR'
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:08:46 [DEBUG   ] spawn_process: at 2019-03-22 04:08:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 04:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:08:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:08:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:08:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:08:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:08:58 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-03-22 04:08:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 04:09:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:09:38 [DEBUG   ] Got command BAM from MCS: ref #99036
2019-03-22 04:09:38 [INFO    ] Finished processing BAM request
2019-03-22 04:09:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99036   8 58564 14978035 A  ERROR'
2019-03-22 04:09:38 [DEBUG   ] Got command BAM from MCS: ref #99035
2019-03-22 04:09:38 [INFO    ] Finished processing BAM request
2019-03-22 04:09:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99035   8 58564 14978039 A  ERROR'
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:09:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:09:38 [DEBUG   ] spawn_process: at 2019-03-22 04:09:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:09:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 04:09:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:09:59 [DEBUG   ] Finished updating ant stats in 1.233 seconds
2019-03-22 04:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 04:09:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:09:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:09:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:09:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:09:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:09:59 [DEBUG   ] Finished updating board flags in 2.057 seconds
2019-03-22 04:10:19 [DEBUG   ] Finished updating ant stats in 1.168 seconds
2019-03-22 04:10:30 [DEBUG   ] Got command BAM from MCS: ref #99037
2019-03-22 04:10:30 [INFO    ] Finished processing BAM request
2019-03-22 04:10:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99037   8 58564 15030027 A  ERROR'
2019-03-22 04:10:30 [DEBUG   ] Got command BAM from MCS: ref #99038
2019-03-22 04:10:30 [INFO    ] Finished processing BAM request
2019-03-22 04:10:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99038   8 58564 15030031 A  ERROR'
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:10:30 [DEBUG   ] spawn_process: at 2019-03-22 04:10:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:10:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:10:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:10:59 [DEBUG   ] Finished updating ant stats in 1.033 seconds
2019-03-22 04:10:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:10:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:10:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:10:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:10:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:10:59 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-03-22 04:11:19 [DEBUG   ] Finished updating ant stats in 0.969 seconds
2019-03-22 04:11:22 [DEBUG   ] Got command BAM from MCS: ref #99039
2019-03-22 04:11:22 [INFO    ] Finished processing BAM request
2019-03-22 04:11:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:11:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99039   8 58564 15082027 A  ERROR'
2019-03-22 04:11:22 [DEBUG   ] Got command BAM from MCS: ref #99040
2019-03-22 04:11:22 [INFO    ] Finished processing BAM request
2019-03-22 04:11:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:11:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99040   8 58564 15082031 A  ERROR'
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:11:22 [DEBUG   ] spawn_process: at 2019-03-22 04:11:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:11:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:11:53 [DEBUG   ] Got command RPT from MCS: ref #99041
2019-03-22 04:11:53 [DEBUG   ] summary = ERROR
2019-03-22 04:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99041  13 58564 15113663 A  ERRORERROR'
2019-03-22 04:11:53 [DEBUG   ] Got command RPT from MCS: ref #99042
2019-03-22 04:11:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99042  77 58564 15113867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:11:54 [DEBUG   ] Got command RPT from MCS: ref #99043
2019-03-22 04:11:54 [DEBUG   ] summary = ERROR
2019-03-22 04:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99043  13 58564 15114059 A  ERRORERROR'
2019-03-22 04:11:54 [DEBUG   ] Got command RPT from MCS: ref #99044
2019-03-22 04:11:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99044  77 58564 15114263 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:11:54 [DEBUG   ] Got command RPT from MCS: ref #99045
2019-03-22 04:11:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99045  12 58564 15114467 A  ERRORB�ff'
2019-03-22 04:11:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:11:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 04:11:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-22 04:11:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:11:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:11:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:11:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:11:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:11:59 [DEBUG   ] Finished updating board flags in 2.124 seconds
2019-03-22 04:12:14 [DEBUG   ] Got command BAM from MCS: ref #99052
2019-03-22 04:12:14 [INFO    ] Finished processing BAM request
2019-03-22 04:12:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:12:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99052   8 58564 15134027 A  ERROR'
2019-03-22 04:12:14 [DEBUG   ] Got command BAM from MCS: ref #99053
2019-03-22 04:12:14 [INFO    ] Finished processing BAM request
2019-03-22 04:12:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:12:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99053   8 58564 15134031 A  ERROR'
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:12:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:12:14 [DEBUG   ] spawn_process: at 2019-03-22 04:12:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:12:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 04:12:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:12:40 [DEBUG   ] Got command RPT from MCS: ref #99054
2019-03-22 04:12:40 [DEBUG   ] summary = ERROR
2019-03-22 04:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99054  13 58564 15160963 A  ERRORERROR'
2019-03-22 04:12:40 [DEBUG   ] Got command RPT from MCS: ref #99055
2019-03-22 04:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99055  77 58564 15160963 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 04:12:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:12:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:12:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:12:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:12:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:12:58 [DEBUG   ] Finished updating board flags in 1.286 seconds
2019-03-22 04:12:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:13:06 [DEBUG   ] Got command BAM from MCS: ref #99072
2019-03-22 04:13:06 [INFO    ] Finished processing BAM request
2019-03-22 04:13:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:13:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99072   8 58564 15186035 A  ERROR'
2019-03-22 04:13:06 [DEBUG   ] Got command BAM from MCS: ref #99071
2019-03-22 04:13:06 [INFO    ] Finished processing BAM request
2019-03-22 04:13:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:13:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99071   8 58564 15186039 A  ERROR'
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:13:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:13:06 [DEBUG   ] spawn_process: at 2019-03-22 04:13:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:13:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:13:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:13:58 [DEBUG   ] Got command BAM from MCS: ref #99073
2019-03-22 04:13:58 [INFO    ] Finished processing BAM request
2019-03-22 04:13:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99073   8 58564 15238035 A  ERROR'
2019-03-22 04:13:58 [DEBUG   ] Got command BAM from MCS: ref #99074
2019-03-22 04:13:58 [INFO    ] Finished processing BAM request
2019-03-22 04:13:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99074   8 58564 15238043 A  ERROR'
2019-03-22 04:13:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:13:58 [DEBUG   ] spawn_process: at 2019-03-22 04:13:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:13:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 04:13:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:13:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:13:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:13:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:13:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:13:59 [DEBUG   ] Finished updating board flags in 1.907 seconds
2019-03-22 04:14:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:14:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:14:50 [DEBUG   ] Got command BAM from MCS: ref #99075
2019-03-22 04:14:50 [INFO    ] Finished processing BAM request
2019-03-22 04:14:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99075   8 58564 15290027 A  ERROR'
2019-03-22 04:14:50 [DEBUG   ] Got command BAM from MCS: ref #99076
2019-03-22 04:14:50 [INFO    ] Finished processing BAM request
2019-03-22 04:14:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99076   8 58564 15290031 A  ERROR'
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:14:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:14:50 [DEBUG   ] spawn_process: at 2019-03-22 04:14:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 04:14:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:14:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:14:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:14:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:14:58 [WARNING ] (13, 1, 'bot')
2019-03-22 04:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:14:58 [DEBUG   ] Finished updating board flags in 1.059 seconds
2019-03-22 04:14:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:15:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 04:15:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:15:42 [DEBUG   ] Got command BAM from MCS: ref #99083
2019-03-22 04:15:42 [INFO    ] Finished processing BAM request
2019-03-22 04:15:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:15:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99083   8 58564 15342031 A  ERROR'
2019-03-22 04:15:42 [DEBUG   ] Got command BAM from MCS: ref #99084
2019-03-22 04:15:42 [INFO    ] Finished processing BAM request
2019-03-22 04:15:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:15:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99084   8 58564 15342035 A  ERROR'
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:15:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:15:42 [DEBUG   ] spawn_process: at 2019-03-22 04:15:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:15:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:15:59 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2019-03-22 04:15:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:15:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:15:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:15:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:15:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:15:59 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-03-22 04:16:19 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2019-03-22 04:16:34 [DEBUG   ] Got command BAM from MCS: ref #99086
2019-03-22 04:16:34 [INFO    ] Finished processing BAM request
2019-03-22 04:16:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99086   8 58564 15394027 A  ERROR'
2019-03-22 04:16:34 [DEBUG   ] Got command BAM from MCS: ref #99085
2019-03-22 04:16:34 [INFO    ] Finished processing BAM request
2019-03-22 04:16:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99085   8 58564 15394031 A  ERROR'
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:16:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:16:34 [DEBUG   ] spawn_process: at 2019-03-22 04:16:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:16:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 04:16:53 [DEBUG   ] Got command RPT from MCS: ref #99089
2019-03-22 04:16:53 [DEBUG   ] summary = ERROR
2019-03-22 04:16:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99089  13 58564 15413747 A  ERRORERROR'
2019-03-22 04:16:53 [DEBUG   ] Got command RPT from MCS: ref #99090
2019-03-22 04:16:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:16:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99090  77 58564 15413951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:16:54 [DEBUG   ] Got command RPT from MCS: ref #99091
2019-03-22 04:16:54 [DEBUG   ] summary = ERROR
2019-03-22 04:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99091  13 58564 15414155 A  ERRORERROR'
2019-03-22 04:16:54 [DEBUG   ] Got command RPT from MCS: ref #99093
2019-03-22 04:16:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99093  77 58564 15414347 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:16:54 [DEBUG   ] Got command RPT from MCS: ref #99095
2019-03-22 04:16:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99095  12 58564 15414551 A  ERRORB�ff'
2019-03-22 04:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 04:16:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:16:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:16:59 [DEBUG   ] Finished updating ant stats in 0.625 seconds
2019-03-22 04:16:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:16:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:16:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:16:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:16:59 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-03-22 04:17:19 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2019-03-22 04:17:26 [DEBUG   ] Got command BAM from MCS: ref #99100
2019-03-22 04:17:26 [INFO    ] Finished processing BAM request
2019-03-22 04:17:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99100   8 58564 15446035 A  ERROR'
2019-03-22 04:17:26 [DEBUG   ] Got command BAM from MCS: ref #99099
2019-03-22 04:17:26 [INFO    ] Finished processing BAM request
2019-03-22 04:17:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99099   8 58564 15446039 A  ERROR'
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:17:26 [DEBUG   ] spawn_process: at 2019-03-22 04:17:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:17:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:17:40 [DEBUG   ] Got command RPT from MCS: ref #99101
2019-03-22 04:17:40 [DEBUG   ] summary = ERROR
2019-03-22 04:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99101  13 58564 15460967 A  ERRORERROR'
2019-03-22 04:17:40 [DEBUG   ] Got command RPT from MCS: ref #99102
2019-03-22 04:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99102  77 58564 15460967 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 04:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:17:59 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2019-03-22 04:17:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:17:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:17:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:17:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:17:59 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-03-22 04:18:18 [DEBUG   ] Got command BAM from MCS: ref #99125
2019-03-22 04:18:18 [INFO    ] Finished processing BAM request
2019-03-22 04:18:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99125   8 58564 15498031 A  ERROR'
2019-03-22 04:18:18 [DEBUG   ] Got command BAM from MCS: ref #99124
2019-03-22 04:18:18 [INFO    ] Finished processing BAM request
2019-03-22 04:18:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99124   8 58564 15498035 A  ERROR'
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:18:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:18:18 [DEBUG   ] spawn_process: at 2019-03-22 04:18:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:18:20 [DEBUG   ] Finished updating ant stats in 1.368 seconds
2019-03-22 04:18:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 04:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 04:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:18:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-22 04:18:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:18:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:18:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:18:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:18:59 [DEBUG   ] Finished updating board flags in 1.347 seconds
2019-03-22 04:19:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:19:10 [DEBUG   ] Got command BAM from MCS: ref #99126
2019-03-22 04:19:10 [INFO    ] Finished processing BAM request
2019-03-22 04:19:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99126   8 58564 15550031 A  ERROR'
2019-03-22 04:19:10 [DEBUG   ] Got command BAM from MCS: ref #99127
2019-03-22 04:19:10 [INFO    ] Finished processing BAM request
2019-03-22 04:19:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99127   8 58564 15550035 A  ERROR'
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:19:10 [DEBUG   ] spawn_process: at 2019-03-22 04:19:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:19:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:19:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:19:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:19:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:19:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:19:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:19:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:19:59 [DEBUG   ] Finished updating board flags in 1.209 seconds
2019-03-22 04:20:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:20:01 [DEBUG   ] Got command BAM from MCS: ref #99128
2019-03-22 04:20:01 [INFO    ] Finished processing BAM request
2019-03-22 04:20:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99128   8 58564 15601035 A  ERROR'
2019-03-22 04:20:01 [DEBUG   ] Got command BAM from MCS: ref #99129
2019-03-22 04:20:01 [INFO    ] Finished processing BAM request
2019-03-22 04:20:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99129   8 58564 15601039 A  ERROR'
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:20:01 [DEBUG   ] spawn_process: at 2019-03-22 04:20:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:20:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:20:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:20:52 [DEBUG   ] Got command BAM from MCS: ref #99131
2019-03-22 04:20:52 [INFO    ] Finished processing BAM request
2019-03-22 04:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99131   8 58564 15652035 A  ERROR'
2019-03-22 04:20:52 [DEBUG   ] Got command BAM from MCS: ref #99130
2019-03-22 04:20:52 [INFO    ] Finished processing BAM request
2019-03-22 04:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99130   8 58564 15652039 A  ERROR'
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:20:52 [DEBUG   ] spawn_process: at 2019-03-22 04:20:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:20:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:20:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:20:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:20:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:20:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:20:59 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-03-22 04:21:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:21:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:21:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:21:43 [DEBUG   ] Got command BAM from MCS: ref #99139
2019-03-22 04:21:43 [INFO    ] Finished processing BAM request
2019-03-22 04:21:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99139   8 58564 15703031 A  ERROR'
2019-03-22 04:21:43 [DEBUG   ] Got command BAM from MCS: ref #99138
2019-03-22 04:21:43 [INFO    ] Finished processing BAM request
2019-03-22 04:21:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99138   8 58564 15703035 A  ERROR'
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:21:43 [DEBUG   ] spawn_process: at 2019-03-22 04:21:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:21:53 [DEBUG   ] Got command RPT from MCS: ref #99140
2019-03-22 04:21:53 [DEBUG   ] summary = ERROR
2019-03-22 04:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99140  13 58564 15713835 A  ERRORERROR'
2019-03-22 04:21:54 [DEBUG   ] Got command RPT from MCS: ref #99141
2019-03-22 04:21:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99141  77 58564 15714039 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:21:54 [DEBUG   ] Got command RPT from MCS: ref #99142
2019-03-22 04:21:54 [DEBUG   ] summary = ERROR
2019-03-22 04:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99142  13 58564 15714243 A  ERRORERROR'
2019-03-22 04:21:54 [DEBUG   ] Got command RPT from MCS: ref #99143
2019-03-22 04:21:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99143  77 58564 15714435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:21:54 [DEBUG   ] Got command RPT from MCS: ref #99144
2019-03-22 04:21:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99144  12 58564 15714639 A  ERRORB�ff'
2019-03-22 04:21:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2019-03-22 04:21:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:21:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:21:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:21:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:21:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:21:59 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-03-22 04:22:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:22:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:22:34 [DEBUG   ] Got command BAM from MCS: ref #99145
2019-03-22 04:22:34 [INFO    ] Finished processing BAM request
2019-03-22 04:22:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99145   8 58564 15754027 A  ERROR'
2019-03-22 04:22:34 [DEBUG   ] Got command BAM from MCS: ref #99146
2019-03-22 04:22:34 [INFO    ] Finished processing BAM request
2019-03-22 04:22:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99146   8 58564 15754031 A  ERROR'
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:22:34 [DEBUG   ] spawn_process: at 2019-03-22 04:22:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:22:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:22:40 [DEBUG   ] Got command RPT from MCS: ref #99147
2019-03-22 04:22:40 [DEBUG   ] summary = ERROR
2019-03-22 04:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99147  13 58564 15760971 A  ERRORERROR'
2019-03-22 04:22:40 [DEBUG   ] Got command RPT from MCS: ref #99148
2019-03-22 04:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99148  77 58564 15760971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:22:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2019-03-22 04:22:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:22:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:22:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:22:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:22:59 [DEBUG   ] Finished updating board flags in 1.228 seconds
2019-03-22 04:23:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:23:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:23:25 [DEBUG   ] Got command BAM from MCS: ref #99164
2019-03-22 04:23:25 [INFO    ] Finished processing BAM request
2019-03-22 04:23:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99164   8 58564 15805027 A  ERROR'
2019-03-22 04:23:25 [DEBUG   ] Got command BAM from MCS: ref #99165
2019-03-22 04:23:25 [INFO    ] Finished processing BAM request
2019-03-22 04:23:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99165   8 58564 15805031 A  ERROR'
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:23:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:23:25 [DEBUG   ] spawn_process: at 2019-03-22 04:23:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:23:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:23:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:23:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:23:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:23:59 [WARNING ] (13, 1, 'bot')
2019-03-22 04:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:23:59 [DEBUG   ] Finished updating board flags in 1.231 seconds
2019-03-22 04:24:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 04:24:16 [DEBUG   ] Got command BAM from MCS: ref #99173
2019-03-22 04:24:16 [INFO    ] Finished processing BAM request
2019-03-22 04:24:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99173   8 58564 15856027 A  ERROR'
2019-03-22 04:24:16 [DEBUG   ] Got command BAM from MCS: ref #99172
2019-03-22 04:24:16 [INFO    ] Finished processing BAM request
2019-03-22 04:24:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99172   8 58564 15856031 A  ERROR'
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:24:16 [DEBUG   ] spawn_process: at 2019-03-22 04:24:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:24:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:24:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:25:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 04:25:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:25:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:25:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:25:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:25:00 [DEBUG   ] Finished updating board flags in 2.272 seconds
2019-03-22 04:25:07 [DEBUG   ] Got command BAM from MCS: ref #99174
2019-03-22 04:25:07 [INFO    ] Finished processing BAM request
2019-03-22 04:25:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99174   8 58564 15907035 A  ERROR'
2019-03-22 04:25:07 [DEBUG   ] Got command BAM from MCS: ref #99175
2019-03-22 04:25:07 [INFO    ] Finished processing BAM request
2019-03-22 04:25:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99175   8 58564 15907039 A  ERROR'
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:25:07 [DEBUG   ] spawn_process: at 2019-03-22 04:25:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:25:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:25:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:25:58 [DEBUG   ] Got command BAM from MCS: ref #99176
2019-03-22 04:25:58 [INFO    ] Finished processing BAM request
2019-03-22 04:25:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99176   8 58564 15958035 A  ERROR'
2019-03-22 04:25:58 [DEBUG   ] Got command BAM from MCS: ref #99177
2019-03-22 04:25:58 [INFO    ] Finished processing BAM request
2019-03-22 04:25:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99177   8 58564 15958039 A  ERROR'
2019-03-22 04:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:25:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:25:58 [DEBUG   ] spawn_process: at 2019-03-22 04:25:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:26:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 04:26:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:26:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:26:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:26:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:26:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:26:00 [DEBUG   ] Finished updating board flags in 2.234 seconds
2019-03-22 04:26:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:26:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:26:49 [DEBUG   ] Got command BAM from MCS: ref #99179
2019-03-22 04:26:49 [INFO    ] Finished processing BAM request
2019-03-22 04:26:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99179   8 58564 16009027 A  ERROR'
2019-03-22 04:26:49 [DEBUG   ] Got command BAM from MCS: ref #99178
2019-03-22 04:26:49 [INFO    ] Finished processing BAM request
2019-03-22 04:26:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99178   8 58564 16009031 A  ERROR'
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:26:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:26:49 [DEBUG   ] spawn_process: at 2019-03-22 04:26:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:26:53 [DEBUG   ] Got command RPT from MCS: ref #99182
2019-03-22 04:26:53 [DEBUG   ] summary = ERROR
2019-03-22 04:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99182  13 58564 16013919 A  ERRORERROR'
2019-03-22 04:26:54 [DEBUG   ] Got command RPT from MCS: ref #99183
2019-03-22 04:26:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99183  77 58564 16014123 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:26:54 [DEBUG   ] Got command RPT from MCS: ref #99184
2019-03-22 04:26:54 [DEBUG   ] summary = ERROR
2019-03-22 04:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99184  13 58564 16014327 A  ERRORERROR'
2019-03-22 04:26:54 [DEBUG   ] Got command RPT from MCS: ref #99186
2019-03-22 04:26:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99186  77 58564 16014519 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:26:54 [DEBUG   ] Got command RPT from MCS: ref #99187
2019-03-22 04:26:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99187  12 58564 16014723 A  ERRORBœ™š'
2019-03-22 04:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:27:00 [DEBUG   ] Finished updating ant stats in 1.227 seconds
2019-03-22 04:27:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:27:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:27:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:27:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:27:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:27:00 [DEBUG   ] Finished updating board flags in 2.048 seconds
2019-03-22 04:27:20 [DEBUG   ] Finished updating ant stats in 1.177 seconds
2019-03-22 04:27:40 [DEBUG   ] Got command BAM from MCS: ref #99198
2019-03-22 04:27:40 [INFO    ] Finished processing BAM request
2019-03-22 04:27:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99198   8 58564 16060027 A  ERROR'
2019-03-22 04:27:40 [DEBUG   ] Got command BAM from MCS: ref #99199
2019-03-22 04:27:40 [INFO    ] Finished processing BAM request
2019-03-22 04:27:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99199   8 58564 16060031 A  ERROR'
2019-03-22 04:27:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:27:40 [DEBUG   ] spawn_process: at 2019-03-22 04:27:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:27:40 [DEBUG   ] Got command RPT from MCS: ref #99200
2019-03-22 04:27:40 [DEBUG   ] summary = ERROR
2019-03-22 04:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99200  13 58564 16060971 A  ERRORERROR'
2019-03-22 04:27:40 [DEBUG   ] Got command RPT from MCS: ref #99201
2019-03-22 04:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99201  77 58564 16060971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:28:00 [DEBUG   ] Finished updating ant stats in 1.023 seconds
2019-03-22 04:28:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:28:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:28:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:28:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:28:00 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-03-22 04:28:20 [DEBUG   ] Finished updating ant stats in 0.977 seconds
2019-03-22 04:28:31 [DEBUG   ] Got command BAM from MCS: ref #99218
2019-03-22 04:28:31 [INFO    ] Finished processing BAM request
2019-03-22 04:28:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99218   8 58564 16111031 A  ERROR'
2019-03-22 04:28:31 [DEBUG   ] Got command BAM from MCS: ref #99217
2019-03-22 04:28:31 [INFO    ] Finished processing BAM request
2019-03-22 04:28:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99217   8 58564 16111035 A  ERROR'
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:28:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:28:31 [DEBUG   ] spawn_process: at 2019-03-22 04:28:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:28:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 04:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:29:00 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2019-03-22 04:29:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:29:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:29:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:29:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:29:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:29:00 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-03-22 04:29:20 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2019-03-22 04:29:22 [DEBUG   ] Got command BAM from MCS: ref #99220
2019-03-22 04:29:22 [INFO    ] Finished processing BAM request
2019-03-22 04:29:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:29:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99220   8 58564 16162031 A  ERROR'
2019-03-22 04:29:22 [DEBUG   ] Got command BAM from MCS: ref #99219
2019-03-22 04:29:22 [INFO    ] Finished processing BAM request
2019-03-22 04:29:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:29:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99219   8 58564 16162035 A  ERROR'
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:29:22 [DEBUG   ] spawn_process: at 2019-03-22 04:29:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:29:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 04:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:30:00 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2019-03-22 04:30:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:30:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:30:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:30:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:30:00 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-03-22 04:30:13 [DEBUG   ] Got command BAM from MCS: ref #99228
2019-03-22 04:30:13 [INFO    ] Finished processing BAM request
2019-03-22 04:30:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99228   8 58564 16213035 A  ERROR'
2019-03-22 04:30:13 [DEBUG   ] Got command BAM from MCS: ref #99227
2019-03-22 04:30:13 [INFO    ] Finished processing BAM request
2019-03-22 04:30:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99227   8 58564 16213039 A  ERROR'
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:30:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:30:13 [DEBUG   ] spawn_process: at 2019-03-22 04:30:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:30:20 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2019-03-22 04:30:40 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:30:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2019-03-22 04:31:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:31:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:31:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:31:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:31:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:31:00 [DEBUG   ] Finished updating board flags in 1.348 seconds
2019-03-22 04:31:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 04:31:04 [DEBUG   ] Got command BAM from MCS: ref #99229
2019-03-22 04:31:04 [INFO    ] Finished processing BAM request
2019-03-22 04:31:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99229   8 58564 16264027 A  ERROR'
2019-03-22 04:31:04 [DEBUG   ] Got command BAM from MCS: ref #99230
2019-03-22 04:31:04 [INFO    ] Finished processing BAM request
2019-03-22 04:31:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99230   8 58564 16264031 A  ERROR'
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:31:04 [DEBUG   ] spawn_process: at 2019-03-22 04:31:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:31:20 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-03-22 04:31:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:31:54 [DEBUG   ] Got command RPT from MCS: ref #99231
2019-03-22 04:31:54 [DEBUG   ] summary = ERROR
2019-03-22 04:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99231  13 58564 16314011 A  ERRORERROR'
2019-03-22 04:31:54 [DEBUG   ] Got command RPT from MCS: ref #99234
2019-03-22 04:31:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99234  77 58564 16314203 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:31:54 [DEBUG   ] Got command RPT from MCS: ref #99235
2019-03-22 04:31:54 [DEBUG   ] summary = ERROR
2019-03-22 04:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99235  13 58564 16314407 A  ERRORERROR'
2019-03-22 04:31:54 [DEBUG   ] Got command RPT from MCS: ref #99236
2019-03-22 04:31:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99236  77 58564 16314611 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:31:54 [DEBUG   ] Got command RPT from MCS: ref #99237
2019-03-22 04:31:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99237  12 58564 16314815 A  ERRORBœ™š'
2019-03-22 04:31:55 [DEBUG   ] Got command BAM from MCS: ref #99233
2019-03-22 04:31:55 [INFO    ] Finished processing BAM request
2019-03-22 04:31:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99233   8 58564 16315035 A  ERROR'
2019-03-22 04:31:55 [DEBUG   ] Got command BAM from MCS: ref #99232
2019-03-22 04:31:55 [INFO    ] Finished processing BAM request
2019-03-22 04:31:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99232   8 58564 16315039 A  ERROR'
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:31:55 [DEBUG   ] spawn_process: at 2019-03-22 04:31:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:31:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:32:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:32:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:32:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:32:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:32:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:32:00 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-03-22 04:32:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 04:32:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:32:40 [DEBUG   ] Got command RPT from MCS: ref #99238
2019-03-22 04:32:40 [DEBUG   ] summary = ERROR
2019-03-22 04:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99238  13 58564 16360971 A  ERRORERROR'
2019-03-22 04:32:40 [DEBUG   ] Got command RPT from MCS: ref #99239
2019-03-22 04:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99239  77 58564 16360971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:32:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:32:46 [DEBUG   ] Got command BAM from MCS: ref #99255
2019-03-22 04:32:46 [INFO    ] Finished processing BAM request
2019-03-22 04:32:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:32:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99255   8 58564 16366027 A  ERROR'
2019-03-22 04:32:46 [DEBUG   ] Got command BAM from MCS: ref #99256
2019-03-22 04:32:46 [INFO    ] Finished processing BAM request
2019-03-22 04:32:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:32:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99256   8 58564 16366031 A  ERROR'
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:32:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:32:46 [DEBUG   ] spawn_process: at 2019-03-22 04:32:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:32:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:33:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 04:33:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:33:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:33:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:33:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:33:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:33:01 [DEBUG   ] Finished updating board flags in 2.507 seconds
2019-03-22 04:33:21 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2019-03-22 04:33:37 [DEBUG   ] Got command BAM from MCS: ref #99264
2019-03-22 04:33:37 [INFO    ] Finished processing BAM request
2019-03-22 04:33:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99264   8 58564 16417027 A  ERROR'
2019-03-22 04:33:37 [DEBUG   ] Got command BAM from MCS: ref #99263
2019-03-22 04:33:37 [INFO    ] Finished processing BAM request
2019-03-22 04:33:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99263   8 58564 16417031 A  ERROR'
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:33:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:33:37 [DEBUG   ] spawn_process: at 2019-03-22 04:33:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:33:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:33:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:34:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:34:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:34:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:34:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:34:00 [DEBUG   ] Finished updating board flags in 1.293 seconds
2019-03-22 04:34:01 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-03-22 04:34:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:34:28 [DEBUG   ] Got command BAM from MCS: ref #99266
2019-03-22 04:34:28 [INFO    ] Finished processing BAM request
2019-03-22 04:34:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:34:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99266   8 58564 16468027 A  ERROR'
2019-03-22 04:34:28 [DEBUG   ] Got command BAM from MCS: ref #99265
2019-03-22 04:34:28 [INFO    ] Finished processing BAM request
2019-03-22 04:34:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:34:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99265   8 58564 16468031 A  ERROR'
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:34:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:34:28 [DEBUG   ] spawn_process: at 2019-03-22 04:34:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:34:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:35:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 04:35:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:35:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:35:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:35:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:35:00 [DEBUG   ] Finished updating board flags in 1.221 seconds
2019-03-22 04:35:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-03-22 04:35:19 [DEBUG   ] Got command BAM from MCS: ref #99267
2019-03-22 04:35:19 [INFO    ] Finished processing BAM request
2019-03-22 04:35:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99267   8 58564 16519035 A  ERROR'
2019-03-22 04:35:19 [DEBUG   ] Got command BAM from MCS: ref #99268
2019-03-22 04:35:19 [INFO    ] Finished processing BAM request
2019-03-22 04:35:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99268   8 58564 16519039 A  ERROR'
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:35:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:35:19 [DEBUG   ] spawn_process: at 2019-03-22 04:35:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:35:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 04:35:41 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 04:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:36:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:36:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:36:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:36:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:36:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:36:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:36:00 [DEBUG   ] Finished updating board flags in 1.161 seconds
2019-03-22 04:36:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-03-22 04:36:10 [DEBUG   ] Got command BAM from MCS: ref #99275
2019-03-22 04:36:10 [INFO    ] Finished processing BAM request
2019-03-22 04:36:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99275   8 58564 16570031 A  ERROR'
2019-03-22 04:36:10 [DEBUG   ] Got command BAM from MCS: ref #99276
2019-03-22 04:36:10 [INFO    ] Finished processing BAM request
2019-03-22 04:36:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:36:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99276   8 58564 16570035 A  ERROR'
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:36:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:36:10 [DEBUG   ] spawn_process: at 2019-03-22 04:36:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:36:21 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:36:41 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:36:54 [DEBUG   ] Got command RPT from MCS: ref #99279
2019-03-22 04:36:54 [DEBUG   ] summary = ERROR
2019-03-22 04:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99279  13 58564 16614095 A  ERRORERROR'
2019-03-22 04:36:54 [DEBUG   ] Got command RPT from MCS: ref #99280
2019-03-22 04:36:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99280  77 58564 16614299 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:36:54 [DEBUG   ] Got command RPT from MCS: ref #99281
2019-03-22 04:36:54 [DEBUG   ] summary = ERROR
2019-03-22 04:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99281  13 58564 16614491 A  ERRORERROR'
2019-03-22 04:36:54 [DEBUG   ] Got command RPT from MCS: ref #99283
2019-03-22 04:36:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99283  77 58564 16614695 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:36:54 [DEBUG   ] Got command RPT from MCS: ref #99284
2019-03-22 04:36:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99284  12 58564 16614899 A  ERRORB›™š'
2019-03-22 04:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:37:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:37:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:37:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:37:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:37:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:37:00 [DEBUG   ] Finished updating board flags in 0.990 seconds
2019-03-22 04:37:01 [DEBUG   ] Got command BAM from MCS: ref #99289
2019-03-22 04:37:01 [INFO    ] Finished processing BAM request
2019-03-22 04:37:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99289   8 58564 16621035 A  ERROR'
2019-03-22 04:37:01 [DEBUG   ] Got command BAM from MCS: ref #99290
2019-03-22 04:37:01 [INFO    ] Finished processing BAM request
2019-03-22 04:37:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99290   8 58564 16621043 A  ERROR'
2019-03-22 04:37:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:37:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:37:01 [DEBUG   ] spawn_process: at 2019-03-22 04:37:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:37:21 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:37:40 [DEBUG   ] Got command RPT from MCS: ref #99291
2019-03-22 04:37:40 [DEBUG   ] summary = ERROR
2019-03-22 04:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99291  13 58564 16660971 A  ERRORERROR'
2019-03-22 04:37:40 [DEBUG   ] Got command RPT from MCS: ref #99292
2019-03-22 04:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99292  77 58564 16660971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:37:41 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 04:37:52 [DEBUG   ] Got command BAM from MCS: ref #99308
2019-03-22 04:37:52 [INFO    ] Finished processing BAM request
2019-03-22 04:37:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:37:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99308   8 58564 16672027 A  ERROR'
2019-03-22 04:37:52 [DEBUG   ] Got command BAM from MCS: ref #99309
2019-03-22 04:37:52 [INFO    ] Finished processing BAM request
2019-03-22 04:37:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:37:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99309   8 58564 16672031 A  ERROR'
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:37:52 [DEBUG   ] spawn_process: at 2019-03-22 04:37:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:38:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:38:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 04:38:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:38:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:38:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:38:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:38:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:38:00 [DEBUG   ] Finished updating board flags in 1.269 seconds
2019-03-22 04:38:01 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-03-22 04:38:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:38:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:38:43 [DEBUG   ] Got command BAM from MCS: ref #99310
2019-03-22 04:38:43 [INFO    ] Finished processing BAM request
2019-03-22 04:38:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99310   8 58564 16723027 A  ERROR'
2019-03-22 04:38:43 [DEBUG   ] Got command BAM from MCS: ref #99311
2019-03-22 04:38:43 [INFO    ] Finished processing BAM request
2019-03-22 04:38:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:38:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99311   8 58564 16723031 A  ERROR'
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:38:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:38:43 [DEBUG   ] spawn_process: at 2019-03-22 04:38:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:39:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:39:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:39:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:39:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:39:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:39:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:39:00 [DEBUG   ] Finished updating board flags in 1.212 seconds
2019-03-22 04:39:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:39:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:39:34 [DEBUG   ] Got command BAM from MCS: ref #99319
2019-03-22 04:39:34 [INFO    ] Finished processing BAM request
2019-03-22 04:39:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:39:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99319   8 58564 16774031 A  ERROR'
2019-03-22 04:39:34 [DEBUG   ] Got command BAM from MCS: ref #99318
2019-03-22 04:39:34 [INFO    ] Finished processing BAM request
2019-03-22 04:39:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:39:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99318   8 58564 16774035 A  ERROR'
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:39:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:39:34 [DEBUG   ] spawn_process: at 2019-03-22 04:39:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:39:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:40:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:40:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:40:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:40:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:40:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:40:01 [DEBUG   ] Finished updating board flags in 1.772 seconds
2019-03-22 04:40:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:40:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 04:40:25 [DEBUG   ] Got command BAM from MCS: ref #99320
2019-03-22 04:40:25 [INFO    ] Finished processing BAM request
2019-03-22 04:40:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99320   8 58564 16825035 A  ERROR'
2019-03-22 04:40:25 [DEBUG   ] Got command BAM from MCS: ref #99321
2019-03-22 04:40:25 [INFO    ] Finished processing BAM request
2019-03-22 04:40:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99321   8 58564 16825039 A  ERROR'
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:40:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:40:25 [DEBUG   ] spawn_process: at 2019-03-22 04:40:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:40:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:41:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:41:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:41:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:41:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:41:00 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-03-22 04:41:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:41:16 [DEBUG   ] Got command BAM from MCS: ref #99323
2019-03-22 04:41:16 [INFO    ] Finished processing BAM request
2019-03-22 04:41:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99323   8 58564 16876031 A  ERROR'
2019-03-22 04:41:16 [DEBUG   ] Got command BAM from MCS: ref #99322
2019-03-22 04:41:16 [INFO    ] Finished processing BAM request
2019-03-22 04:41:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99322   8 58564 16876035 A  ERROR'
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:41:16 [DEBUG   ] spawn_process: at 2019-03-22 04:41:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:41:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:41:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:41:54 [DEBUG   ] Got command RPT from MCS: ref #99324
2019-03-22 04:41:54 [DEBUG   ] summary = ERROR
2019-03-22 04:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99324  13 58564 16914175 A  ERRORERROR'
2019-03-22 04:41:54 [DEBUG   ] Got command RPT from MCS: ref #99325
2019-03-22 04:41:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99325  77 58564 16914379 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:41:54 [DEBUG   ] Got command RPT from MCS: ref #99326
2019-03-22 04:41:54 [DEBUG   ] summary = ERROR
2019-03-22 04:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99326  13 58564 16914583 A  ERRORERROR'
2019-03-22 04:41:54 [DEBUG   ] Got command RPT from MCS: ref #99327
2019-03-22 04:41:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99327  77 58564 16914775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:41:54 [DEBUG   ] Got command RPT from MCS: ref #99328
2019-03-22 04:41:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99328  12 58564 16914979 A  ERRORBœ™š'
2019-03-22 04:42:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:42:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:42:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:42:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:42:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:42:00 [DEBUG   ] Finished updating board flags in 1.091 seconds
2019-03-22 04:42:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 04:42:07 [DEBUG   ] Got command BAM from MCS: ref #99335
2019-03-22 04:42:07 [INFO    ] Finished processing BAM request
2019-03-22 04:42:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:42:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99335   8 58564 16927027 A  ERROR'
2019-03-22 04:42:07 [DEBUG   ] Got command BAM from MCS: ref #99336
2019-03-22 04:42:07 [INFO    ] Finished processing BAM request
2019-03-22 04:42:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:42:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99336   8 58564 16927031 A  ERROR'
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:42:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:42:07 [DEBUG   ] spawn_process: at 2019-03-22 04:42:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:42:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:42:40 [DEBUG   ] Got command RPT from MCS: ref #99337
2019-03-22 04:42:40 [DEBUG   ] summary = ERROR
2019-03-22 04:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99337  13 58564 16960975 A  ERRORERROR'
2019-03-22 04:42:40 [DEBUG   ] Got command RPT from MCS: ref #99338
2019-03-22 04:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99338  77 58564 16960975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:42:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:42:58 [DEBUG   ] Got command BAM from MCS: ref #99354
2019-03-22 04:42:58 [INFO    ] Finished processing BAM request
2019-03-22 04:42:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:42:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99354   8 58564 16978031 A  ERROR'
2019-03-22 04:42:58 [DEBUG   ] Got command BAM from MCS: ref #99355
2019-03-22 04:42:58 [INFO    ] Finished processing BAM request
2019-03-22 04:42:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:42:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99355   8 58564 16978035 A  ERROR'
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:42:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:42:58 [DEBUG   ] spawn_process: at 2019-03-22 04:42:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:43:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:43:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:43:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:43:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:43:00 [WARNING ] (13, 1, 'bot')
2019-03-22 04:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:43:00 [DEBUG   ] Finished updating board flags in 0.911 seconds
2019-03-22 04:43:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:43:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:43:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:43:49 [DEBUG   ] Got command BAM from MCS: ref #99357
2019-03-22 04:43:49 [INFO    ] Finished processing BAM request
2019-03-22 04:43:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:43:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99357   8 58564 17029035 A  ERROR'
2019-03-22 04:43:49 [DEBUG   ] Got command BAM from MCS: ref #99356
2019-03-22 04:43:49 [INFO    ] Finished processing BAM request
2019-03-22 04:43:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:43:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99356   8 58564 17029039 A  ERROR'
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:43:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:43:49 [DEBUG   ] spawn_process: at 2019-03-22 04:43:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:44:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:44:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:44:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:44:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:44:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:44:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:44:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:44:01 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-03-22 04:44:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:44:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:44:40 [DEBUG   ] Got command BAM from MCS: ref #99359
2019-03-22 04:44:40 [INFO    ] Finished processing BAM request
2019-03-22 04:44:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99359   8 58564 17080035 A  ERROR'
2019-03-22 04:44:40 [DEBUG   ] Got command BAM from MCS: ref #99358
2019-03-22 04:44:40 [INFO    ] Finished processing BAM request
2019-03-22 04:44:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99358   8 58564 17080039 A  ERROR'
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:44:40 [DEBUG   ] spawn_process: at 2019-03-22 04:44:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:44:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:45:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:45:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:45:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:45:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:45:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:45:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:45:01 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-03-22 04:45:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:45:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:45:31 [DEBUG   ] Got command BAM from MCS: ref #99367
2019-03-22 04:45:31 [INFO    ] Finished processing BAM request
2019-03-22 04:45:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99367   8 58564 17131035 A  ERROR'
2019-03-22 04:45:31 [DEBUG   ] Got command BAM from MCS: ref #99366
2019-03-22 04:45:31 [INFO    ] Finished processing BAM request
2019-03-22 04:45:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99366   8 58564 17131039 A  ERROR'
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:45:31 [DEBUG   ] spawn_process: at 2019-03-22 04:45:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:45:42 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 04:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 04:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:46:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:46:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:46:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:46:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:46:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:46:01 [DEBUG   ] Finished updating board flags in 1.336 seconds
2019-03-22 04:46:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:46:22 [DEBUG   ] Got command BAM from MCS: ref #99369
2019-03-22 04:46:22 [INFO    ] Finished processing BAM request
2019-03-22 04:46:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99369   8 58564 17182031 A  ERROR'
2019-03-22 04:46:22 [DEBUG   ] Got command BAM from MCS: ref #99368
2019-03-22 04:46:22 [INFO    ] Finished processing BAM request
2019-03-22 04:46:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99368   8 58564 17182035 A  ERROR'
2019-03-22 04:46:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 04:46:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 04:46:22 [DEBUG   ] spawn_process: at 2019-03-22 04:46:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 04:46:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:46:54 [DEBUG   ] Got command RPT from MCS: ref #99372
2019-03-22 04:46:54 [DEBUG   ] summary = ERROR
2019-03-22 04:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99372  13 58564 17214267 A  ERRORERROR'
2019-03-22 04:46:54 [DEBUG   ] Got command RPT from MCS: ref #99373
2019-03-22 04:46:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99373  77 58564 17214459 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:46:54 [DEBUG   ] Got command RPT from MCS: ref #99374
2019-03-22 04:46:54 [DEBUG   ] summary = ERROR
2019-03-22 04:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99374  13 58564 17214663 A  ERRORERROR'
2019-03-22 04:46:54 [DEBUG   ] Got command RPT from MCS: ref #99376
2019-03-22 04:46:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99376  77 58564 17214867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:46:55 [DEBUG   ] Got command RPT from MCS: ref #99377
2019-03-22 04:46:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99377  12 58564 17215071 A  ERRORBœ™š'
2019-03-22 04:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:47:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:47:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:47:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:47:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:47:01 [DEBUG   ] Finished updating board flags in 1.221 seconds
2019-03-22 04:47:02 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 04:47:13 [DEBUG   ] Got command BAM from MCS: ref #99382
2019-03-22 04:47:13 [INFO    ] Finished processing BAM request
2019-03-22 04:47:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:47:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99382   8 58564 17233031 A  ERROR'
2019-03-22 04:47:13 [DEBUG   ] Got command BAM from MCS: ref #99383
2019-03-22 04:47:13 [INFO    ] Finished processing BAM request
2019-03-22 04:47:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:47:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99383   8 58564 17233035 A  ERROR'
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:47:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:47:13 [DEBUG   ] spawn_process: at 2019-03-22 04:47:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:47:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:47:40 [DEBUG   ] Got command RPT from MCS: ref #99384
2019-03-22 04:47:40 [DEBUG   ] summary = ERROR
2019-03-22 04:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99384  13 58564 17260975 A  ERRORERROR'
2019-03-22 04:47:40 [DEBUG   ] Got command RPT from MCS: ref #99385
2019-03-22 04:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99385  77 58564 17260975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:47:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 04:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:48:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:48:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:48:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:48:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:48:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:48:01 [DEBUG   ] Finished updating board flags in 1.162 seconds
2019-03-22 04:48:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-03-22 04:48:04 [DEBUG   ] Got command BAM from MCS: ref #99407
2019-03-22 04:48:04 [INFO    ] Finished processing BAM request
2019-03-22 04:48:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:48:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99407   8 58564 17284035 A  ERROR'
2019-03-22 04:48:04 [DEBUG   ] Got command BAM from MCS: ref #99408
2019-03-22 04:48:04 [INFO    ] Finished processing BAM request
2019-03-22 04:48:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:48:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99408   8 58564 17284039 A  ERROR'
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:48:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:48:04 [DEBUG   ] spawn_process: at 2019-03-22 04:48:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:48:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 04:48:42 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2019-03-22 04:48:55 [DEBUG   ] Got command BAM from MCS: ref #99410
2019-03-22 04:48:55 [INFO    ] Finished processing BAM request
2019-03-22 04:48:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99410   8 58564 17335027 A  ERROR'
2019-03-22 04:48:55 [DEBUG   ] Got command BAM from MCS: ref #99409
2019-03-22 04:48:55 [INFO    ] Finished processing BAM request
2019-03-22 04:48:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99409   8 58564 17335031 A  ERROR'
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 04:48:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 04:48:55 [DEBUG   ] spawn_process: at 2019-03-22 04:48:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 04:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:49:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:49:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:49:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:49:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:49:01 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-03-22 04:49:02 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:49:22 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:49:42 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:49:46 [DEBUG   ] Got command BAM from MCS: ref #99412
2019-03-22 04:49:46 [INFO    ] Finished processing BAM request
2019-03-22 04:49:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99412   8 58564 17386035 A  ERROR'
2019-03-22 04:49:46 [DEBUG   ] Got command BAM from MCS: ref #99411
2019-03-22 04:49:46 [INFO    ] Finished processing BAM request
2019-03-22 04:49:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99411   8 58564 17386039 A  ERROR'
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:49:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:49:46 [DEBUG   ] spawn_process: at 2019-03-22 04:49:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 04:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:50:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:50:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:50:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:50:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:50:01 [DEBUG   ] Finished updating board flags in 0.981 seconds
2019-03-22 04:50:02 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:50:22 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 04:50:37 [DEBUG   ] Got command BAM from MCS: ref #99413
2019-03-22 04:50:37 [INFO    ] Finished processing BAM request
2019-03-22 04:50:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99413   8 58564 17437035 A  ERROR'
2019-03-22 04:50:37 [DEBUG   ] Got command BAM from MCS: ref #99414
2019-03-22 04:50:37 [INFO    ] Finished processing BAM request
2019-03-22 04:50:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:50:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99414   8 58564 17437039 A  ERROR'
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:50:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:50:37 [DEBUG   ] spawn_process: at 2019-03-22 04:50:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:50:42 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-03-22 04:51:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 04:51:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:51:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:51:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:51:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:51:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:51:02 [DEBUG   ] Finished updating board flags in 1.909 seconds
2019-03-22 04:51:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 04:51:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:51:28 [DEBUG   ] Got command BAM from MCS: ref #99421
2019-03-22 04:51:28 [INFO    ] Finished processing BAM request
2019-03-22 04:51:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:51:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99421   8 58564 17488031 A  ERROR'
2019-03-22 04:51:28 [DEBUG   ] Got command BAM from MCS: ref #99422
2019-03-22 04:51:28 [INFO    ] Finished processing BAM request
2019-03-22 04:51:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:51:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99422   8 58564 17488035 A  ERROR'
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:51:28 [DEBUG   ] spawn_process: at 2019-03-22 04:51:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:51:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:51:54 [DEBUG   ] Got command RPT from MCS: ref #99423
2019-03-22 04:51:54 [DEBUG   ] summary = ERROR
2019-03-22 04:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99423  13 58564 17514343 A  ERRORERROR'
2019-03-22 04:51:54 [DEBUG   ] Got command RPT from MCS: ref #99424
2019-03-22 04:51:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99424  77 58564 17514547 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:51:54 [DEBUG   ] Got command RPT from MCS: ref #99425
2019-03-22 04:51:54 [DEBUG   ] summary = ERROR
2019-03-22 04:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99425  13 58564 17514751 A  ERRORERROR'
2019-03-22 04:51:54 [DEBUG   ] Got command RPT from MCS: ref #99426
2019-03-22 04:51:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99426  77 58564 17514943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:51:55 [DEBUG   ] Got command RPT from MCS: ref #99427
2019-03-22 04:51:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99427  12 58564 17515147 A  ERRORBœ™š'
2019-03-22 04:52:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:52:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 04:52:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 04:52:03 [WARNING ] (13, 1, 'bot')
2019-03-22 04:52:03 [WARNING ] (13, 1, 'bot')
2019-03-22 04:52:03 [WARNING ] (13, 1, 'bot')
2019-03-22 04:52:03 [WARNING ] (13, 1, 'bot')
2019-03-22 04:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:52:03 [DEBUG   ] Finished updating board flags in 2.841 seconds
2019-03-22 04:52:19 [DEBUG   ] Got command BAM from MCS: ref #99429
2019-03-22 04:52:19 [INFO    ] Finished processing BAM request
2019-03-22 04:52:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99429   8 58564 17539027 A  ERROR'
2019-03-22 04:52:19 [DEBUG   ] Got command BAM from MCS: ref #99428
2019-03-22 04:52:19 [INFO    ] Finished processing BAM request
2019-03-22 04:52:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99428   8 58564 17539031 A  ERROR'
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:52:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:52:19 [DEBUG   ] spawn_process: at 2019-03-22 04:52:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:52:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:52:40 [DEBUG   ] Got command RPT from MCS: ref #99430
2019-03-22 04:52:40 [DEBUG   ] summary = ERROR
2019-03-22 04:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99430  13 58564 17560967 A  ERRORERROR'
2019-03-22 04:52:40 [DEBUG   ] Got command RPT from MCS: ref #99431
2019-03-22 04:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99431  77 58564 17560967 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:52:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:53:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:53:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:53:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:53:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:53:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:53:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:53:02 [DEBUG   ] Finished updating board flags in 1.694 seconds
2019-03-22 04:53:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:53:11 [DEBUG   ] Got command BAM from MCS: ref #99448
2019-03-22 04:53:11 [INFO    ] Finished processing BAM request
2019-03-22 04:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99448   8 58564 17591031 A  ERROR'
2019-03-22 04:53:11 [DEBUG   ] Got command BAM from MCS: ref #99447
2019-03-22 04:53:11 [INFO    ] Finished processing BAM request
2019-03-22 04:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99447   8 58564 17591035 A  ERROR'
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 04:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 04:53:11 [DEBUG   ] spawn_process: at 2019-03-22 04:53:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 04:53:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:53:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:54:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:54:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 04:54:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:54:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:54:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:54:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:54:01 [DEBUG   ] Finished updating board flags in 1.089 seconds
2019-03-22 04:54:03 [DEBUG   ] Got command BAM from MCS: ref #99456
2019-03-22 04:54:03 [INFO    ] Finished processing BAM request
2019-03-22 04:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99456   8 58564 17643035 A  ERROR'
2019-03-22 04:54:03 [DEBUG   ] Got command BAM from MCS: ref #99455
2019-03-22 04:54:03 [INFO    ] Finished processing BAM request
2019-03-22 04:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99455   8 58564 17643039 A  ERROR'
2019-03-22 04:54:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:54:03 [DEBUG   ] spawn_process: at 2019-03-22 04:54:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:54:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:54:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:54:55 [DEBUG   ] Got command BAM from MCS: ref #99458
2019-03-22 04:54:55 [INFO    ] Finished processing BAM request
2019-03-22 04:54:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99458   8 58564 17695027 A  ERROR'
2019-03-22 04:54:55 [DEBUG   ] Got command BAM from MCS: ref #99457
2019-03-22 04:54:55 [INFO    ] Finished processing BAM request
2019-03-22 04:54:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99457   8 58564 17695031 A  ERROR'
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:54:55 [DEBUG   ] spawn_process: at 2019-03-22 04:54:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:55:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 04:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 04:55:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:55:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:55:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:55:01 [WARNING ] (13, 1, 'bot')
2019-03-22 04:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:55:01 [DEBUG   ] Finished updating board flags in 0.953 seconds
2019-03-22 04:55:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:55:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:55:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:55:47 [DEBUG   ] Got command BAM from MCS: ref #99460
2019-03-22 04:55:47 [INFO    ] Finished processing BAM request
2019-03-22 04:55:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:55:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99460   8 58564 17747027 A  ERROR'
2019-03-22 04:55:47 [DEBUG   ] Got command BAM from MCS: ref #99459
2019-03-22 04:55:47 [INFO    ] Finished processing BAM request
2019-03-22 04:55:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:55:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99459   8 58564 17747031 A  ERROR'
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:55:47 [DEBUG   ] spawn_process: at 2019-03-22 04:55:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:56:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:56:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:56:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:56:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:56:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:56:02 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-03-22 04:56:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:56:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:56:39 [DEBUG   ] Got command BAM from MCS: ref #99462
2019-03-22 04:56:39 [INFO    ] Finished processing BAM request
2019-03-22 04:56:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99462   8 58564 17799031 A  ERROR'
2019-03-22 04:56:39 [DEBUG   ] Got command BAM from MCS: ref #99461
2019-03-22 04:56:39 [INFO    ] Finished processing BAM request
2019-03-22 04:56:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99461   8 58564 17799035 A  ERROR'
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:56:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:56:39 [DEBUG   ] spawn_process: at 2019-03-22 04:56:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:56:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 04:56:54 [DEBUG   ] Got command RPT from MCS: ref #99465
2019-03-22 04:56:54 [DEBUG   ] summary = ERROR
2019-03-22 04:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99465  13 58564 17814431 A  ERRORERROR'
2019-03-22 04:56:54 [DEBUG   ] Got command RPT from MCS: ref #99466
2019-03-22 04:56:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99466  77 58564 17814635 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:56:54 [DEBUG   ] Got command RPT from MCS: ref #99467
2019-03-22 04:56:54 [DEBUG   ] summary = ERROR
2019-03-22 04:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99467  13 58564 17814839 A  ERRORERROR'
2019-03-22 04:56:55 [DEBUG   ] Got command RPT from MCS: ref #99469
2019-03-22 04:56:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99469  77 58564 17815031 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:56:55 [DEBUG   ] Got command RPT from MCS: ref #99470
2019-03-22 04:56:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 04:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99470  12 58564 17815235 A  ERRORB›™š'
2019-03-22 04:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 04:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:57:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:57:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:57:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:57:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:57:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:57:02 [DEBUG   ] Finished updating board flags in 1.200 seconds
2019-03-22 04:57:03 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 04:57:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:57:31 [DEBUG   ] Got command BAM from MCS: ref #99482
2019-03-22 04:57:31 [INFO    ] Finished processing BAM request
2019-03-22 04:57:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99482   8 58564 17851035 A  ERROR'
2019-03-22 04:57:31 [DEBUG   ] Got command BAM from MCS: ref #99481
2019-03-22 04:57:31 [INFO    ] Finished processing BAM request
2019-03-22 04:57:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99481   8 58564 17851039 A  ERROR'
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:57:31 [DEBUG   ] spawn_process: at 2019-03-22 04:57:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:57:40 [DEBUG   ] Got command RPT from MCS: ref #99483
2019-03-22 04:57:40 [DEBUG   ] summary = ERROR
2019-03-22 04:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99483  13 58564 17860975 A  ERRORERROR'
2019-03-22 04:57:40 [DEBUG   ] Got command RPT from MCS: ref #99484
2019-03-22 04:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 04:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99484  77 58564 17860975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 04:57:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:58:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 04:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:58:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:58:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:58:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:58:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:58:02 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-03-22 04:58:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:58:23 [DEBUG   ] Got command BAM from MCS: ref #99500
2019-03-22 04:58:23 [INFO    ] Finished processing BAM request
2019-03-22 04:58:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99500   8 58564 17903027 A  ERROR'
2019-03-22 04:58:23 [DEBUG   ] Got command BAM from MCS: ref #99501
2019-03-22 04:58:23 [INFO    ] Finished processing BAM request
2019-03-22 04:58:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99501   8 58564 17903031 A  ERROR'
2019-03-22 04:58:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 04:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 04:58:23 [DEBUG   ] spawn_process: at 2019-03-22 04:58:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 04:58:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 04:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 04:59:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:59:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:59:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:59:02 [WARNING ] (13, 1, 'bot')
2019-03-22 04:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 04:59:02 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-03-22 04:59:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:59:15 [DEBUG   ] Got command BAM from MCS: ref #99502
2019-03-22 04:59:15 [INFO    ] Finished processing BAM request
2019-03-22 04:59:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:59:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99502   8 58564 17955035 A  ERROR'
2019-03-22 04:59:15 [DEBUG   ] Got command BAM from MCS: ref #99503
2019-03-22 04:59:15 [INFO    ] Finished processing BAM request
2019-03-22 04:59:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 04:59:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99503   8 58564 17955039 A  ERROR'
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 04:59:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 04:59:15 [DEBUG   ] spawn_process: at 2019-03-22 04:59:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 04:59:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 04:59:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:00:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:00:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:00:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:00:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:00:02 [DEBUG   ] Finished updating board flags in 1.443 seconds
2019-03-22 05:00:03 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 05:00:07 [DEBUG   ] Got command BAM from MCS: ref #99511
2019-03-22 05:00:07 [INFO    ] Finished processing BAM request
2019-03-22 05:00:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99511   8 58564 18007031 A  ERROR'
2019-03-22 05:00:07 [DEBUG   ] Got command BAM from MCS: ref #99510
2019-03-22 05:00:07 [INFO    ] Finished processing BAM request
2019-03-22 05:00:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99510   8 58564 18007035 A  ERROR'
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 05:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 05:00:07 [DEBUG   ] spawn_process: at 2019-03-22 05:00:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 05:00:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:00:44 [DEBUG   ] Finished updating ant stats in 1.801 seconds
2019-03-22 05:00:59 [DEBUG   ] Got command BAM from MCS: ref #99512
2019-03-22 05:00:59 [INFO    ] Finished processing BAM request
2019-03-22 05:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99512   8 58564 18059031 A  ERROR'
2019-03-22 05:00:59 [DEBUG   ] Got command BAM from MCS: ref #99513
2019-03-22 05:00:59 [INFO    ] Finished processing BAM request
2019-03-22 05:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99513   8 58564 18059035 A  ERROR'
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:00:59 [DEBUG   ] spawn_process: at 2019-03-22 05:00:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:01:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:01:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:01:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:01:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:01:02 [DEBUG   ] Finished updating board flags in 1.121 seconds
2019-03-22 05:01:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:01:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:01:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:01:51 [DEBUG   ] Got command BAM from MCS: ref #99514
2019-03-22 05:01:51 [INFO    ] Finished processing BAM request
2019-03-22 05:01:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99514   8 58564 18111031 A  ERROR'
2019-03-22 05:01:51 [DEBUG   ] Got command BAM from MCS: ref #99515
2019-03-22 05:01:51 [INFO    ] Finished processing BAM request
2019-03-22 05:01:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99515   8 58564 18111035 A  ERROR'
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 05:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 05:01:51 [DEBUG   ] spawn_process: at 2019-03-22 05:01:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 05:01:54 [DEBUG   ] Got command RPT from MCS: ref #99516
2019-03-22 05:01:54 [DEBUG   ] summary = ERROR
2019-03-22 05:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99516  13 58564 18114515 A  ERRORERROR'
2019-03-22 05:01:54 [DEBUG   ] Got command RPT from MCS: ref #99517
2019-03-22 05:01:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99517  77 58564 18114719 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:01:54 [DEBUG   ] Got command RPT from MCS: ref #99518
2019-03-22 05:01:54 [DEBUG   ] summary = ERROR
2019-03-22 05:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99518  13 58564 18114923 A  ERRORERROR'
2019-03-22 05:01:55 [DEBUG   ] Got command RPT from MCS: ref #99519
2019-03-22 05:01:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99519  77 58564 18115127 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:01:55 [DEBUG   ] Got command RPT from MCS: ref #99520
2019-03-22 05:01:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99520  12 58564 18115319 A  ERRORB›™š'
2019-03-22 05:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 05:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:02:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:02:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:02:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:02:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:02:02 [DEBUG   ] Finished updating board flags in 1.057 seconds
2019-03-22 05:02:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:02:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:02:40 [DEBUG   ] Got command RPT from MCS: ref #99521
2019-03-22 05:02:40 [DEBUG   ] summary = ERROR
2019-03-22 05:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99521  13 58564 18160975 A  ERRORERROR'
2019-03-22 05:02:40 [DEBUG   ] Got command RPT from MCS: ref #99522
2019-03-22 05:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99522  77 58564 18160975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:02:43 [DEBUG   ] Got command BAM from MCS: ref #99538
2019-03-22 05:02:43 [INFO    ] Finished processing BAM request
2019-03-22 05:02:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99538   8 58564 18163035 A  ERROR'
2019-03-22 05:02:43 [DEBUG   ] Got command BAM from MCS: ref #99539
2019-03-22 05:02:43 [INFO    ] Finished processing BAM request
2019-03-22 05:02:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99539   8 58564 18163039 A  ERROR'
2019-03-22 05:02:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 05:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 05:02:43 [DEBUG   ] spawn_process: at 2019-03-22 05:02:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 05:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 05:03:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:03:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 05:03:03 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2019-03-22 05:03:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 05:03:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:03:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:03:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:03:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:03:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:03:03 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-03-22 05:03:23 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2019-03-22 05:03:36 [DEBUG   ] Got command BAM from MCS: ref #99546
2019-03-22 05:03:36 [INFO    ] Finished processing BAM request
2019-03-22 05:03:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99546   8 58564 18216035 A  ERROR'
2019-03-22 05:03:36 [DEBUG   ] Got command BAM from MCS: ref #99547
2019-03-22 05:03:36 [INFO    ] Finished processing BAM request
2019-03-22 05:03:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99547   8 58564 18216039 A  ERROR'
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 05:03:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 05:03:36 [DEBUG   ] spawn_process: at 2019-03-22 05:03:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 05:03:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 05:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 05:04:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:04:03 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2019-03-22 05:04:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:04:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:04:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:04:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:04:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:04:03 [DEBUG   ] Finished updating board flags in 1.968 seconds
2019-03-22 05:04:23 [DEBUG   ] Finished updating ant stats in 0.577 seconds
2019-03-22 05:04:29 [DEBUG   ] Got command BAM from MCS: ref #99548
2019-03-22 05:04:29 [INFO    ] Finished processing BAM request
2019-03-22 05:04:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99548   8 58564 18269035 A  ERROR'
2019-03-22 05:04:29 [DEBUG   ] Got command BAM from MCS: ref #99549
2019-03-22 05:04:29 [INFO    ] Finished processing BAM request
2019-03-22 05:04:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99549   8 58564 18269039 A  ERROR'
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 05:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 05:04:29 [DEBUG   ] spawn_process: at 2019-03-22 05:04:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 05:04:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 05:05:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:05:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:05:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:05:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:05:02 [DEBUG   ] Finished updating board flags in 1.253 seconds
2019-03-22 05:05:03 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:05:22 [DEBUG   ] Got command BAM from MCS: ref #99551
2019-03-22 05:05:22 [INFO    ] Finished processing BAM request
2019-03-22 05:05:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99551   8 58564 18322027 A  ERROR'
2019-03-22 05:05:22 [DEBUG   ] Got command BAM from MCS: ref #99550
2019-03-22 05:05:22 [INFO    ] Finished processing BAM request
2019-03-22 05:05:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99550   8 58564 18322031 A  ERROR'
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 05:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 05:05:22 [DEBUG   ] spawn_process: at 2019-03-22 05:05:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 05:05:24 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 05:05:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 05:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:06:03 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2019-03-22 05:06:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:06:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:06:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:06:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:06:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:06:03 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-03-22 05:06:15 [DEBUG   ] Got command BAM from MCS: ref #99559
2019-03-22 05:06:15 [INFO    ] Finished processing BAM request
2019-03-22 05:06:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99559   8 58564 18375035 A  ERROR'
2019-03-22 05:06:15 [DEBUG   ] Got command BAM from MCS: ref #99558
2019-03-22 05:06:15 [INFO    ] Finished processing BAM request
2019-03-22 05:06:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99558   8 58564 18375039 A  ERROR'
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 05:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 05:06:15 [DEBUG   ] spawn_process: at 2019-03-22 05:06:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 05:06:23 [DEBUG   ] Finished updating ant stats in 0.373 seconds
2019-03-22 05:06:44 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 05:06:54 [DEBUG   ] Got command RPT from MCS: ref #99562
2019-03-22 05:06:54 [DEBUG   ] summary = ERROR
2019-03-22 05:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99562  13 58564 18414611 A  ERRORERROR'
2019-03-22 05:06:54 [DEBUG   ] Got command RPT from MCS: ref #99563
2019-03-22 05:06:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99563  77 58564 18414803 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:06:55 [DEBUG   ] Got command RPT from MCS: ref #99564
2019-03-22 05:06:55 [DEBUG   ] summary = ERROR
2019-03-22 05:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99564  13 58564 18415007 A  ERRORERROR'
2019-03-22 05:06:55 [DEBUG   ] Got command RPT from MCS: ref #99566
2019-03-22 05:06:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99566  77 58564 18415211 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:06:55 [DEBUG   ] Got command RPT from MCS: ref #99567
2019-03-22 05:06:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99567  12 58564 18415415 A  ERRORBœ™š'
2019-03-22 05:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-03-22 05:07:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:07:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:07:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:07:02 [WARNING ] (13, 1, 'bot')
2019-03-22 05:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:07:02 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-03-22 05:07:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:07:08 [DEBUG   ] Got command BAM from MCS: ref #99573
2019-03-22 05:07:08 [INFO    ] Finished processing BAM request
2019-03-22 05:07:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99573   8 58564 18428035 A  ERROR'
2019-03-22 05:07:08 [DEBUG   ] Got command BAM from MCS: ref #99572
2019-03-22 05:07:08 [INFO    ] Finished processing BAM request
2019-03-22 05:07:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99572   8 58564 18428039 A  ERROR'
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 05:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 05:07:08 [DEBUG   ] spawn_process: at 2019-03-22 05:07:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 05:07:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:07:40 [DEBUG   ] Got command RPT from MCS: ref #99574
2019-03-22 05:07:40 [DEBUG   ] summary = ERROR
2019-03-22 05:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99574  13 58564 18460979 A  ERRORERROR'
2019-03-22 05:07:40 [DEBUG   ] Got command RPT from MCS: ref #99575
2019-03-22 05:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99575  77 58564 18460979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:07:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:08:01 [DEBUG   ] Got command BAM from MCS: ref #99592
2019-03-22 05:08:01 [INFO    ] Finished processing BAM request
2019-03-22 05:08:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99592   8 58564 18481035 A  ERROR'
2019-03-22 05:08:01 [DEBUG   ] Got command BAM from MCS: ref #99591
2019-03-22 05:08:01 [INFO    ] Finished processing BAM request
2019-03-22 05:08:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99591   8 58564 18481039 A  ERROR'
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 05:08:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 05:08:01 [DEBUG   ] spawn_process: at 2019-03-22 05:08:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 05:08:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 05:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:08:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:08:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:08:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:08:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:08:03 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-03-22 05:08:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:08:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 05:08:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:08:54 [DEBUG   ] Got command BAM from MCS: ref #99594
2019-03-22 05:08:54 [INFO    ] Finished processing BAM request
2019-03-22 05:08:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99594   8 58564 18534031 A  ERROR'
2019-03-22 05:08:54 [DEBUG   ] Got command BAM from MCS: ref #99593
2019-03-22 05:08:54 [INFO    ] Finished processing BAM request
2019-03-22 05:08:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99593   8 58564 18534035 A  ERROR'
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:08:54 [DEBUG   ] spawn_process: at 2019-03-22 05:08:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-03-22 05:09:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:09:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:09:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:09:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:09:03 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-03-22 05:09:04 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 05:09:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 05:09:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:09:47 [DEBUG   ] Got command BAM from MCS: ref #99602
2019-03-22 05:09:47 [INFO    ] Finished processing BAM request
2019-03-22 05:09:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:09:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99602   8 58564 18587031 A  ERROR'
2019-03-22 05:09:47 [DEBUG   ] Got command BAM from MCS: ref #99601
2019-03-22 05:09:47 [INFO    ] Finished processing BAM request
2019-03-22 05:09:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:09:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99601   8 58564 18587035 A  ERROR'
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 05:09:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 05:09:47 [DEBUG   ] spawn_process: at 2019-03-22 05:09:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 05:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:10:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:10:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:10:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:10:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:10:03 [DEBUG   ] Finished updating board flags in 1.190 seconds
2019-03-22 05:10:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:10:24 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2019-03-22 05:10:40 [DEBUG   ] Got command BAM from MCS: ref #99603
2019-03-22 05:10:40 [INFO    ] Finished processing BAM request
2019-03-22 05:10:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99603   8 58564 18640031 A  ERROR'
2019-03-22 05:10:40 [DEBUG   ] Got command BAM from MCS: ref #99604
2019-03-22 05:10:40 [INFO    ] Finished processing BAM request
2019-03-22 05:10:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99604   8 58564 18640035 A  ERROR'
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:10:40 [DEBUG   ] spawn_process: at 2019-03-22 05:10:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:10:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 05:11:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:11:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:11:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:11:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:11:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:11:03 [DEBUG   ] Finished updating board flags in 1.491 seconds
2019-03-22 05:11:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 05:11:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 05:11:34 [DEBUG   ] Got command BAM from MCS: ref #99606
2019-03-22 05:11:34 [INFO    ] Finished processing BAM request
2019-03-22 05:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99606   8 58564 18694027 A  ERROR'
2019-03-22 05:11:34 [DEBUG   ] Got command BAM from MCS: ref #99605
2019-03-22 05:11:34 [INFO    ] Finished processing BAM request
2019-03-22 05:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99605   8 58564 18694031 A  ERROR'
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:11:34 [DEBUG   ] spawn_process: at 2019-03-22 05:11:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:11:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 05:11:54 [DEBUG   ] Got command RPT from MCS: ref #99607
2019-03-22 05:11:54 [DEBUG   ] summary = ERROR
2019-03-22 05:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99607  13 58564 18714695 A  ERRORERROR'
2019-03-22 05:11:54 [DEBUG   ] Got command RPT from MCS: ref #99608
2019-03-22 05:11:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99608  77 58564 18714887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:11:55 [DEBUG   ] Got command RPT from MCS: ref #99609
2019-03-22 05:11:55 [DEBUG   ] summary = ERROR
2019-03-22 05:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99609  13 58564 18715091 A  ERRORERROR'
2019-03-22 05:11:55 [DEBUG   ] Got command RPT from MCS: ref #99610
2019-03-22 05:11:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99610  77 58564 18715295 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:11:55 [DEBUG   ] Got command RPT from MCS: ref #99611
2019-03-22 05:11:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99611  12 58564 18715499 A  ERRORBžff'
2019-03-22 05:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 05:12:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:12:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 05:12:04 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2019-03-22 05:12:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:12:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:12:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:12:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:12:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:12:04 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-03-22 05:12:24 [DEBUG   ] Finished updating ant stats in 0.577 seconds
2019-03-22 05:12:28 [DEBUG   ] Got command BAM from MCS: ref #99619
2019-03-22 05:12:28 [INFO    ] Finished processing BAM request
2019-03-22 05:12:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99619   8 58564 18748027 A  ERROR'
2019-03-22 05:12:28 [DEBUG   ] Got command BAM from MCS: ref #99618
2019-03-22 05:12:28 [INFO    ] Finished processing BAM request
2019-03-22 05:12:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99618   8 58564 18748031 A  ERROR'
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:12:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:12:28 [DEBUG   ] spawn_process: at 2019-03-22 05:12:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:12:40 [DEBUG   ] Got command RPT from MCS: ref #99620
2019-03-22 05:12:40 [DEBUG   ] summary = ERROR
2019-03-22 05:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99620  13 58564 18760979 A  ERRORERROR'
2019-03-22 05:12:40 [DEBUG   ] Got command RPT from MCS: ref #99621
2019-03-22 05:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99621  77 58564 18760979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:12:44 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-03-22 05:13:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:13:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:13:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:13:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:13:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:13:03 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-03-22 05:13:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:13:22 [DEBUG   ] Got command BAM from MCS: ref #99637
2019-03-22 05:13:22 [INFO    ] Finished processing BAM request
2019-03-22 05:13:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99637   8 58564 18802031 A  ERROR'
2019-03-22 05:13:22 [DEBUG   ] Got command BAM from MCS: ref #99638
2019-03-22 05:13:22 [INFO    ] Finished processing BAM request
2019-03-22 05:13:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99638   8 58564 18802035 A  ERROR'
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:13:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:13:22 [DEBUG   ] spawn_process: at 2019-03-22 05:13:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:13:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:13:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 05:14:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:14:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:14:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:14:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:14:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:14:03 [DEBUG   ] Finished updating board flags in 1.169 seconds
2019-03-22 05:14:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:14:16 [DEBUG   ] Got command BAM from MCS: ref #99639
2019-03-22 05:14:16 [INFO    ] Finished processing BAM request
2019-03-22 05:14:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99639   8 58564 18856031 A  ERROR'
2019-03-22 05:14:16 [DEBUG   ] Got command BAM from MCS: ref #99640
2019-03-22 05:14:16 [INFO    ] Finished processing BAM request
2019-03-22 05:14:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99640   8 58564 18856035 A  ERROR'
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:14:16 [DEBUG   ] spawn_process: at 2019-03-22 05:14:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:14:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:14:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 05:15:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:15:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:15:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:15:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:15:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:15:03 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-03-22 05:15:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:15:10 [DEBUG   ] Got command BAM from MCS: ref #99648
2019-03-22 05:15:10 [INFO    ] Finished processing BAM request
2019-03-22 05:15:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99648   8 58564 18910031 A  ERROR'
2019-03-22 05:15:10 [DEBUG   ] Got command BAM from MCS: ref #99647
2019-03-22 05:15:10 [INFO    ] Finished processing BAM request
2019-03-22 05:15:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99647   8 58564 18910035 A  ERROR'
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 05:15:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 05:15:10 [DEBUG   ] spawn_process: at 2019-03-22 05:15:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 05:15:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:15:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:16:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:16:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 05:16:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:16:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:16:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:16:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:16:03 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-03-22 05:16:04 [DEBUG   ] Got command BAM from MCS: ref #99650
2019-03-22 05:16:04 [INFO    ] Finished processing BAM request
2019-03-22 05:16:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99650   8 58564 18964035 A  ERROR'
2019-03-22 05:16:04 [DEBUG   ] Got command BAM from MCS: ref #99649
2019-03-22 05:16:04 [INFO    ] Finished processing BAM request
2019-03-22 05:16:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99649   8 58564 18964043 A  ERROR'
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 05:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 05:16:04 [DEBUG   ] spawn_process: at 2019-03-22 05:16:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 05:16:05 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 05:16:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:16:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:16:54 [DEBUG   ] Got command RPT from MCS: ref #99653
2019-03-22 05:16:54 [DEBUG   ] summary = ERROR
2019-03-22 05:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99653  13 58564 19014779 A  ERRORERROR'
2019-03-22 05:16:54 [DEBUG   ] Got command RPT from MCS: ref #99654
2019-03-22 05:16:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99654  77 58564 19014971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:16:55 [DEBUG   ] Got command RPT from MCS: ref #99655
2019-03-22 05:16:55 [DEBUG   ] summary = ERROR
2019-03-22 05:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99655  13 58564 19015175 A  ERRORERROR'
2019-03-22 05:16:55 [DEBUG   ] Got command RPT from MCS: ref #99657
2019-03-22 05:16:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99657  77 58564 19015379 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:16:55 [DEBUG   ] Got command RPT from MCS: ref #99658
2019-03-22 05:16:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99658  12 58564 19015583 A  ERRORBœ™š'
2019-03-22 05:16:59 [DEBUG   ] Got command BAM from MCS: ref #99664
2019-03-22 05:16:59 [INFO    ] Finished processing BAM request
2019-03-22 05:16:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99664   8 58564 19019031 A  ERROR'
2019-03-22 05:16:59 [DEBUG   ] Got command BAM from MCS: ref #99663
2019-03-22 05:16:59 [INFO    ] Finished processing BAM request
2019-03-22 05:16:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99663   8 58564 19019035 A  ERROR'
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 05:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 05:16:59 [DEBUG   ] spawn_process: at 2019-03-22 05:16:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 05:17:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-03-22 05:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:17:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:17:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:17:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:17:03 [WARNING ] (13, 1, 'bot')
2019-03-22 05:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:17:03 [DEBUG   ] Finished updating board flags in 0.979 seconds
2019-03-22 05:17:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:17:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 05:17:40 [DEBUG   ] Got command RPT from MCS: ref #99665
2019-03-22 05:17:40 [DEBUG   ] summary = ERROR
2019-03-22 05:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99665  13 58564 19060983 A  ERRORERROR'
2019-03-22 05:17:40 [DEBUG   ] Got command RPT from MCS: ref #99666
2019-03-22 05:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99666  77 58564 19060983 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:17:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:17:54 [DEBUG   ] Got command BAM from MCS: ref #99683
2019-03-22 05:17:54 [INFO    ] Finished processing BAM request
2019-03-22 05:17:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:17:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99683   8 58564 19074031 A  ERROR'
2019-03-22 05:17:54 [DEBUG   ] Got command BAM from MCS: ref #99682
2019-03-22 05:17:54 [INFO    ] Finished processing BAM request
2019-03-22 05:17:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:17:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99682   8 58564 19074035 A  ERROR'
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 05:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 05:17:54 [DEBUG   ] spawn_process: at 2019-03-22 05:17:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 05:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:18:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:18:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:18:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:18:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:18:04 [DEBUG   ] Finished updating board flags in 1.360 seconds
2019-03-22 05:18:05 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2019-03-22 05:18:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:18:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:18:49 [DEBUG   ] Got command BAM from MCS: ref #99691
2019-03-22 05:18:49 [INFO    ] Finished processing BAM request
2019-03-22 05:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99691   8 58564 19129031 A  ERROR'
2019-03-22 05:18:49 [DEBUG   ] Got command BAM from MCS: ref #99690
2019-03-22 05:18:49 [INFO    ] Finished processing BAM request
2019-03-22 05:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99690   8 58564 19129035 A  ERROR'
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 05:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 05:18:49 [DEBUG   ] spawn_process: at 2019-03-22 05:18:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 05:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-03-22 05:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:19:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:19:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:19:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:19:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:19:04 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-03-22 05:19:05 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 05:19:25 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 05:19:44 [DEBUG   ] Got command BAM from MCS: ref #99692
2019-03-22 05:19:44 [INFO    ] Finished processing BAM request
2019-03-22 05:19:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:19:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99692   8 58564 19184031 A  ERROR'
2019-03-22 05:19:44 [DEBUG   ] Got command BAM from MCS: ref #99693
2019-03-22 05:19:44 [INFO    ] Finished processing BAM request
2019-03-22 05:19:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:19:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99693   8 58564 19184035 A  ERROR'
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 05:19:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 05:19:44 [DEBUG   ] spawn_process: at 2019-03-22 05:19:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 05:19:45 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 05:20:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:20:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:20:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:20:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:20:04 [DEBUG   ] Finished updating board flags in 1.161 seconds
2019-03-22 05:20:05 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:20:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:20:39 [DEBUG   ] Got command BAM from MCS: ref #99695
2019-03-22 05:20:39 [INFO    ] Finished processing BAM request
2019-03-22 05:20:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99695   8 58564 19239035 A  ERROR'
2019-03-22 05:20:39 [DEBUG   ] Got command BAM from MCS: ref #99694
2019-03-22 05:20:39 [INFO    ] Finished processing BAM request
2019-03-22 05:20:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99694   8 58564 19239039 A  ERROR'
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 05:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 05:20:39 [DEBUG   ] spawn_process: at 2019-03-22 05:20:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 05:20:45 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 05:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 05:21:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:21:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:21:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:21:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:21:04 [DEBUG   ] Finished updating board flags in 1.038 seconds
2019-03-22 05:21:05 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:21:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-03-22 05:21:34 [DEBUG   ] Got command BAM from MCS: ref #99703
2019-03-22 05:21:34 [INFO    ] Finished processing BAM request
2019-03-22 05:21:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:21:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99703   8 58564 19294031 A  ERROR'
2019-03-22 05:21:34 [DEBUG   ] Got command BAM from MCS: ref #99702
2019-03-22 05:21:34 [INFO    ] Finished processing BAM request
2019-03-22 05:21:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:21:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99702   8 58564 19294035 A  ERROR'
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:21:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:21:34 [DEBUG   ] spawn_process: at 2019-03-22 05:21:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:21:45 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:21:54 [DEBUG   ] Got command RPT from MCS: ref #99704
2019-03-22 05:21:54 [DEBUG   ] summary = ERROR
2019-03-22 05:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99704  13 58564 19314855 A  ERRORERROR'
2019-03-22 05:21:55 [DEBUG   ] Got command RPT from MCS: ref #99705
2019-03-22 05:21:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99705  77 58564 19315059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:21:55 [DEBUG   ] Got command RPT from MCS: ref #99706
2019-03-22 05:21:55 [DEBUG   ] summary = ERROR
2019-03-22 05:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99706  13 58564 19315263 A  ERRORERROR'
2019-03-22 05:21:55 [DEBUG   ] Got command RPT from MCS: ref #99707
2019-03-22 05:21:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99707  77 58564 19315467 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:21:55 [DEBUG   ] Got command RPT from MCS: ref #99708
2019-03-22 05:21:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99708  12 58564 19315659 A  ERRORBœ™š'
2019-03-22 05:22:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 05:22:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:22:05 [DEBUG   ] Finished updating ant stats in 0.428 seconds
2019-03-22 05:22:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:22:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:22:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:22:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:22:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:22:05 [DEBUG   ] Finished updating board flags in 2.040 seconds
2019-03-22 05:22:25 [DEBUG   ] Finished updating ant stats in 0.377 seconds
2019-03-22 05:22:30 [DEBUG   ] Got command BAM from MCS: ref #99709
2019-03-22 05:22:30 [INFO    ] Finished processing BAM request
2019-03-22 05:22:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99709   8 58564 19350031 A  ERROR'
2019-03-22 05:22:30 [DEBUG   ] Got command BAM from MCS: ref #99710
2019-03-22 05:22:30 [INFO    ] Finished processing BAM request
2019-03-22 05:22:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99710   8 58564 19350035 A  ERROR'
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 05:22:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 05:22:30 [DEBUG   ] spawn_process: at 2019-03-22 05:22:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 05:22:40 [DEBUG   ] Got command RPT from MCS: ref #99711
2019-03-22 05:22:40 [DEBUG   ] summary = ERROR
2019-03-22 05:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99711  13 58564 19360979 A  ERRORERROR'
2019-03-22 05:22:40 [DEBUG   ] Got command RPT from MCS: ref #99712
2019-03-22 05:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99712  77 58564 19360979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:22:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 05:23:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2019-03-22 05:23:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:23:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:23:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:23:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:23:04 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-03-22 05:23:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:23:26 [DEBUG   ] Got command BAM from MCS: ref #99729
2019-03-22 05:23:26 [INFO    ] Finished processing BAM request
2019-03-22 05:23:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99729   8 58564 19406031 A  ERROR'
2019-03-22 05:23:26 [DEBUG   ] Got command BAM from MCS: ref #99728
2019-03-22 05:23:26 [INFO    ] Finished processing BAM request
2019-03-22 05:23:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99728   8 58564 19406035 A  ERROR'
2019-03-22 05:23:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 05:23:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 05:23:26 [DEBUG   ] spawn_process: at 2019-03-22 05:23:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 05:23:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:24:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:24:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 05:24:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:24:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:24:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:24:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:24:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:24:05 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-03-22 05:24:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:24:22 [DEBUG   ] Got command BAM from MCS: ref #99737
2019-03-22 05:24:22 [INFO    ] Finished processing BAM request
2019-03-22 05:24:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:24:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99737   8 58564 19462027 A  ERROR'
2019-03-22 05:24:22 [DEBUG   ] Got command BAM from MCS: ref #99736
2019-03-22 05:24:22 [INFO    ] Finished processing BAM request
2019-03-22 05:24:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:24:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99736   8 58564 19462031 A  ERROR'
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-03-22 05:24:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-03-22 05:24:22 [DEBUG   ] spawn_process: at 2019-03-22 05:24:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-03-22 05:24:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:24:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:25:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:25:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:25:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:25:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:25:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:25:04 [DEBUG   ] Finished updating board flags in 1.197 seconds
2019-03-22 05:25:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:25:18 [DEBUG   ] Got command BAM from MCS: ref #99739
2019-03-22 05:25:18 [INFO    ] Finished processing BAM request
2019-03-22 05:25:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99739   8 58564 19518031 A  ERROR'
2019-03-22 05:25:18 [DEBUG   ] Got command BAM from MCS: ref #99738
2019-03-22 05:25:18 [INFO    ] Finished processing BAM request
2019-03-22 05:25:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99738   8 58564 19518035 A  ERROR'
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 05:25:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 05:25:18 [DEBUG   ] spawn_process: at 2019-03-22 05:25:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 05:25:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:25:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:26:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 05:26:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:26:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:26:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:26:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:26:04 [DEBUG   ] Finished updating board flags in 1.044 seconds
2019-03-22 05:26:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:26:14 [DEBUG   ] Got command BAM from MCS: ref #99740
2019-03-22 05:26:14 [INFO    ] Finished processing BAM request
2019-03-22 05:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99740   8 58564 19574031 A  ERROR'
2019-03-22 05:26:14 [DEBUG   ] Got command BAM from MCS: ref #99741
2019-03-22 05:26:14 [INFO    ] Finished processing BAM request
2019-03-22 05:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99741   8 58564 19574035 A  ERROR'
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:26:14 [DEBUG   ] spawn_process: at 2019-03-22 05:26:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:26:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:26:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:26:54 [DEBUG   ] Got command RPT from MCS: ref #99744
2019-03-22 05:26:54 [DEBUG   ] summary = ERROR
2019-03-22 05:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99744  13 58564 19614943 A  ERRORERROR'
2019-03-22 05:26:55 [DEBUG   ] Got command RPT from MCS: ref #99745
2019-03-22 05:26:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99745  77 58564 19615147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:26:55 [DEBUG   ] Got command RPT from MCS: ref #99746
2019-03-22 05:26:55 [DEBUG   ] summary = ERROR
2019-03-22 05:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99746  13 58564 19615351 A  ERRORERROR'
2019-03-22 05:26:55 [DEBUG   ] Got command RPT from MCS: ref #99748
2019-03-22 05:26:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99748  77 58564 19615555 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:26:55 [DEBUG   ] Got command RPT from MCS: ref #99749
2019-03-22 05:26:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99749  12 58564 19615747 A  ERRORBœ™š'
2019-03-22 05:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:27:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:27:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:27:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:27:04 [WARNING ] (13, 1, 'bot')
2019-03-22 05:27:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:27:04 [DEBUG   ] Finished updating board flags in 0.947 seconds
2019-03-22 05:27:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:27:11 [DEBUG   ] Got command BAM from MCS: ref #99761
2019-03-22 05:27:11 [INFO    ] Finished processing BAM request
2019-03-22 05:27:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99761   8 58564 19631035 A  ERROR'
2019-03-22 05:27:11 [DEBUG   ] Got command BAM from MCS: ref #99760
2019-03-22 05:27:11 [INFO    ] Finished processing BAM request
2019-03-22 05:27:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99760   8 58564 19631039 A  ERROR'
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:27:11 [DEBUG   ] spawn_process: at 2019-03-22 05:27:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:27:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:27:40 [DEBUG   ] Got command RPT from MCS: ref #99762
2019-03-22 05:27:40 [DEBUG   ] summary = ERROR
2019-03-22 05:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99762  13 58564 19660987 A  ERRORERROR'
2019-03-22 05:27:40 [DEBUG   ] Got command RPT from MCS: ref #99763
2019-03-22 05:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99763  77 58564 19660987 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:27:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:28:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:28:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:28:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:28:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:28:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:28:05 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-03-22 05:28:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:28:08 [DEBUG   ] Got command BAM from MCS: ref #99780
2019-03-22 05:28:08 [INFO    ] Finished processing BAM request
2019-03-22 05:28:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99780   8 58564 19688031 A  ERROR'
2019-03-22 05:28:08 [DEBUG   ] Got command BAM from MCS: ref #99779
2019-03-22 05:28:08 [INFO    ] Finished processing BAM request
2019-03-22 05:28:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99779   8 58564 19688035 A  ERROR'
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-03-22 05:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-03-22 05:28:08 [DEBUG   ] spawn_process: at 2019-03-22 05:28:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-03-22 05:28:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:28:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:29:05 [DEBUG   ] Got command BAM from MCS: ref #99782
2019-03-22 05:29:05 [INFO    ] Finished processing BAM request
2019-03-22 05:29:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99782   8 58564 19745035 A  ERROR'
2019-03-22 05:29:05 [DEBUG   ] Got command BAM from MCS: ref #99781
2019-03-22 05:29:05 [INFO    ] Finished processing BAM request
2019-03-22 05:29:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99781   8 58564 19745039 A  ERROR'
2019-03-22 05:29:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 05:29:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:29:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:29:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:29:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:29:05 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:29:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:29:05 [DEBUG   ] spawn_process: at 2019-03-22 05:29:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:29:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:29:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:29:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:30:02 [DEBUG   ] Got command BAM from MCS: ref #99789
2019-03-22 05:30:02 [INFO    ] Finished processing BAM request
2019-03-22 05:30:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99789   8 58564 19802035 A  ERROR'
2019-03-22 05:30:02 [DEBUG   ] Got command BAM from MCS: ref #99790
2019-03-22 05:30:02 [INFO    ] Finished processing BAM request
2019-03-22 05:30:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99790   8 58564 19802039 A  ERROR'
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 05:30:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 05:30:02 [DEBUG   ] spawn_process: at 2019-03-22 05:30:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 05:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:30:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2019-03-22 05:30:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 05:30:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 05:30:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:30:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:30:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:30:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:30:05 [DEBUG   ] Finished updating board flags in 1.240 seconds
2019-03-22 05:30:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:30:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:30:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:31:00 [DEBUG   ] Got command BAM from MCS: ref #99792
2019-03-22 05:31:00 [INFO    ] Finished processing BAM request
2019-03-22 05:31:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99792   8 58564 19860027 A  ERROR'
2019-03-22 05:31:00 [DEBUG   ] Got command BAM from MCS: ref #99791
2019-03-22 05:31:00 [INFO    ] Finished processing BAM request
2019-03-22 05:31:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99791   8 58564 19860031 A  ERROR'
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 05:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 05:31:00 [DEBUG   ] spawn_process: at 2019-03-22 05:31:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 05:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:31:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:31:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:31:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:31:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:31:05 [DEBUG   ] Finished updating board flags in 1.215 seconds
2019-03-22 05:31:06 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 05:31:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:31:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:31:55 [DEBUG   ] Got command RPT from MCS: ref #99793
2019-03-22 05:31:55 [DEBUG   ] summary = ERROR
2019-03-22 05:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99793  13 58564 19915031 A  ERRORERROR'
2019-03-22 05:31:55 [DEBUG   ] Got command RPT from MCS: ref #99794
2019-03-22 05:31:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99794  77 58564 19915235 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:31:55 [DEBUG   ] Got command RPT from MCS: ref #99795
2019-03-22 05:31:55 [DEBUG   ] summary = ERROR
2019-03-22 05:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99795  13 58564 19915439 A  ERRORERROR'
2019-03-22 05:31:55 [DEBUG   ] Got command RPT from MCS: ref #99796
2019-03-22 05:31:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99796  77 58564 19915631 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:31:55 [DEBUG   ] Got command RPT from MCS: ref #99797
2019-03-22 05:31:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99797  12 58564 19915835 A  ERRORBœ™š'
2019-03-22 05:31:58 [DEBUG   ] Got command BAM from MCS: ref #99799
2019-03-22 05:31:58 [INFO    ] Finished processing BAM request
2019-03-22 05:31:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99799   8 58564 19918035 A  ERROR'
2019-03-22 05:31:58 [DEBUG   ] Got command BAM from MCS: ref #99798
2019-03-22 05:31:58 [INFO    ] Finished processing BAM request
2019-03-22 05:31:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99798   8 58564 19918039 A  ERROR'
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 05:31:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 05:31:58 [DEBUG   ] spawn_process: at 2019-03-22 05:31:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 05:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:32:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:32:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:32:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:32:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:32:05 [DEBUG   ] Finished updating board flags in 1.155 seconds
2019-03-22 05:32:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:32:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:32:40 [DEBUG   ] Got command RPT from MCS: ref #99800
2019-03-22 05:32:40 [DEBUG   ] summary = ERROR
2019-03-22 05:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99800  13 58564 19960987 A  ERRORERROR'
2019-03-22 05:32:40 [DEBUG   ] Got command RPT from MCS: ref #99801
2019-03-22 05:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99801  77 58564 19960987 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:32:46 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 05:32:56 [DEBUG   ] Got command BAM from MCS: ref #99817
2019-03-22 05:32:56 [INFO    ] Finished processing BAM request
2019-03-22 05:32:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:32:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99817   8 58564 19976035 A  ERROR'
2019-03-22 05:32:56 [DEBUG   ] Got command BAM from MCS: ref #99818
2019-03-22 05:32:56 [INFO    ] Finished processing BAM request
2019-03-22 05:32:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:32:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99818   8 58564 19976039 A  ERROR'
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-03-22 05:32:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-03-22 05:32:56 [DEBUG   ] spawn_process: at 2019-03-22 05:32:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-03-22 05:33:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-03-22 05:33:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:33:06 [DEBUG   ] Finished updating ant stats in 0.827 seconds
2019-03-22 05:33:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:33:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:33:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:33:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:33:06 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-03-22 05:33:26 [DEBUG   ] Finished updating ant stats in 0.776 seconds
2019-03-22 05:33:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 05:33:54 [DEBUG   ] Got command BAM from MCS: ref #99826
2019-03-22 05:33:54 [INFO    ] Finished processing BAM request
2019-03-22 05:33:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99826   8 58564 20034031 A  ERROR'
2019-03-22 05:33:54 [DEBUG   ] Got command BAM from MCS: ref #99825
2019-03-22 05:33:54 [INFO    ] Finished processing BAM request
2019-03-22 05:33:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99825   8 58564 20034035 A  ERROR'
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:33:54 [DEBUG   ] spawn_process: at 2019-03-22 05:33:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:34:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:34:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-03-22 05:34:06 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2019-03-22 05:34:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:34:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:34:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:34:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:34:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:34:06 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-03-22 05:34:26 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2019-03-22 05:34:46 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:34:53 [DEBUG   ] Got command BAM from MCS: ref #99827
2019-03-22 05:34:53 [INFO    ] Finished processing BAM request
2019-03-22 05:34:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99827   8 58564 20093027 A  ERROR'
2019-03-22 05:34:53 [DEBUG   ] Got command BAM from MCS: ref #99828
2019-03-22 05:34:53 [INFO    ] Finished processing BAM request
2019-03-22 05:34:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-03-22 05:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    99828   8 58564 20093031 A  ERROR'
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-03-22 05:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-03-22 05:34:53 [DEBUG   ] spawn_process: at 2019-03-22 05:34:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-03-22 05:35:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:35:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2019-03-22 05:35:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 05:35:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:35:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:35:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:35:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:35:05 [DEBUG   ] Finished updating board flags in 1.218 seconds
2019-03-22 05:35:06 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 05:35:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:35:40 [DEBUG   ] Got command STP from MCS: ref #99829
2019-03-22 05:35:40 [INFO    ] Finished processing BAM request
2019-03-22 05:35:40 [INFO    ] Shutdown the adder chain on beam #2
2019-03-22 05:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    99829   8 58564 20140035 A  ERROR'
2019-03-22 05:35:40 [DEBUG   ] Got command STP from MCS: ref #99830
2019-03-22 05:35:40 [INFO    ] Finished processing BAM request
2019-03-22 05:35:40 [INFO    ] Shutdown the adder chain on beam #3
2019-03-22 05:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    99830   8 58564 20140039 A  ERROR'
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-03-22 05:35:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-03-22 05:35:40 [DEBUG   ] spawn_process: at 2019-03-22 05:35:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-03-22 05:35:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:36:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:36:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:36:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:36:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:36:05 [DEBUG   ] Finished updating board flags in 1.204 seconds
2019-03-22 05:36:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:36:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:36:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:36:55 [DEBUG   ] Got command RPT from MCS: ref #99839
2019-03-22 05:36:55 [DEBUG   ] summary = ERROR
2019-03-22 05:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99839  13 58564 20215119 A  ERRORERROR'
2019-03-22 05:36:55 [DEBUG   ] Got command RPT from MCS: ref #99840
2019-03-22 05:36:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99840  77 58564 20215323 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:36:55 [DEBUG   ] Got command RPT from MCS: ref #99841
2019-03-22 05:36:55 [DEBUG   ] summary = ERROR
2019-03-22 05:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99841  13 58564 20215515 A  ERRORERROR'
2019-03-22 05:36:55 [DEBUG   ] Got command RPT from MCS: ref #99843
2019-03-22 05:36:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99843  77 58564 20215719 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:36:55 [DEBUG   ] Got command RPT from MCS: ref #99844
2019-03-22 05:36:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99844  12 58564 20215923 A  ERRORB˜™š'
2019-03-22 05:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:37:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 05:37:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:37:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:37:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:37:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:37:05 [DEBUG   ] Finished updating board flags in 1.231 seconds
2019-03-22 05:37:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 05:37:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:37:40 [DEBUG   ] Got command RPT from MCS: ref #99849
2019-03-22 05:37:40 [DEBUG   ] summary = ERROR
2019-03-22 05:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99849  13 58564 20260983 A  ERRORERROR'
2019-03-22 05:37:40 [DEBUG   ] Got command RPT from MCS: ref #99850
2019-03-22 05:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99850  77 58564 20260983 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:37:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:38:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:38:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:38:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:38:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:38:05 [DEBUG   ] Finished updating board flags in 1.180 seconds
2019-03-22 05:38:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:38:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:38:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:39:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:39:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:39:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:39:05 [WARNING ] (13, 1, 'bot')
2019-03-22 05:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:39:05 [DEBUG   ] Finished updating board flags in 1.043 seconds
2019-03-22 05:39:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:39:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:39:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:40:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 05:40:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:40:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:40:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:40:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:40:06 [DEBUG   ] Finished updating board flags in 1.552 seconds
2019-03-22 05:40:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:40:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:40:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:41:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:41:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:41:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:41:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:41:06 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-03-22 05:41:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:41:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:41:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:41:55 [DEBUG   ] Got command RPT from MCS: ref #99872
2019-03-22 05:41:55 [DEBUG   ] summary = ERROR
2019-03-22 05:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99872  13 58564 20515199 A  ERRORERROR'
2019-03-22 05:41:55 [DEBUG   ] Got command RPT from MCS: ref #99873
2019-03-22 05:41:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99873  77 58564 20515403 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:41:55 [DEBUG   ] Got command RPT from MCS: ref #99874
2019-03-22 05:41:55 [DEBUG   ] summary = ERROR
2019-03-22 05:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99874  13 58564 20515607 A  ERRORERROR'
2019-03-22 05:41:55 [DEBUG   ] Got command RPT from MCS: ref #99875
2019-03-22 05:41:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99875  77 58564 20515811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:41:56 [DEBUG   ] Got command RPT from MCS: ref #99876
2019-03-22 05:41:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99876  12 58564 20516003 A  ERRORB“™š'
2019-03-22 05:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:42:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:42:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:42:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:42:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:42:06 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-03-22 05:42:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:42:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:42:40 [DEBUG   ] Got command RPT from MCS: ref #99883
2019-03-22 05:42:40 [DEBUG   ] summary = ERROR
2019-03-22 05:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99883  13 58564 20560991 A  ERRORERROR'
2019-03-22 05:42:40 [DEBUG   ] Got command RPT from MCS: ref #99884
2019-03-22 05:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99884  77 58564 20560991 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:42:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:43:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:43:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:43:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:43:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:43:06 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-03-22 05:43:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:43:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:43:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:44:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:44:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:44:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:44:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:44:06 [DEBUG   ] Finished updating board flags in 1.320 seconds
2019-03-22 05:44:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:44:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:44:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:45:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:45:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:45:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:45:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:45:06 [DEBUG   ] Finished updating board flags in 1.218 seconds
2019-03-22 05:45:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:45:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:45:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:46:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:46:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:46:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:46:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:46:06 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-03-22 05:46:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:46:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:46:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:46:55 [DEBUG   ] Got command RPT from MCS: ref #99908
2019-03-22 05:46:55 [DEBUG   ] summary = ERROR
2019-03-22 05:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99908  13 58564 20815291 A  ERRORERROR'
2019-03-22 05:46:55 [DEBUG   ] Got command RPT from MCS: ref #99909
2019-03-22 05:46:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99909  77 58564 20815495 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:46:55 [DEBUG   ] Got command RPT from MCS: ref #99910
2019-03-22 05:46:55 [DEBUG   ] summary = ERROR
2019-03-22 05:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99910  13 58564 20815687 A  ERRORERROR'
2019-03-22 05:46:55 [DEBUG   ] Got command RPT from MCS: ref #99912
2019-03-22 05:46:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99912  77 58564 20815891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:46:56 [DEBUG   ] Got command RPT from MCS: ref #99914
2019-03-22 05:46:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99914  12 58564 20816095 A  ERRORB”™š'
2019-03-22 05:47:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:47:07 [DEBUG   ] Finished updating ant stats in 1.224 seconds
2019-03-22 05:47:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:47:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:47:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:47:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:47:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:47:07 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-03-22 05:47:27 [DEBUG   ] Finished updating ant stats in 1.172 seconds
2019-03-22 05:47:40 [DEBUG   ] Got command RPT from MCS: ref #99918
2019-03-22 05:47:40 [DEBUG   ] summary = ERROR
2019-03-22 05:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99918  13 58564 20860991 A  ERRORERROR'
2019-03-22 05:47:40 [DEBUG   ] Got command RPT from MCS: ref #99919
2019-03-22 05:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99919  77 58564 20860991 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:47:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 05:48:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 05:48:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:48:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:48:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:48:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:48:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:48:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:48:07 [DEBUG   ] Finished updating board flags in 2.371 seconds
2019-03-22 05:48:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:48:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:49:07 [DEBUG   ] Finished updating ant stats in 0.827 seconds
2019-03-22 05:49:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:49:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:49:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:49:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:49:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:49:07 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-03-22 05:49:27 [DEBUG   ] Finished updating ant stats in 0.777 seconds
2019-03-22 05:49:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 05:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:50:07 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2019-03-22 05:50:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:50:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:50:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:50:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:50:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:50:07 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-03-22 05:50:27 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2019-03-22 05:50:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-03-22 05:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 05:51:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:51:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:51:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:51:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:51:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:51:06 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-03-22 05:51:07 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-03-22 05:51:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:51:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:51:55 [DEBUG   ] Got command RPT from MCS: ref #99947
2019-03-22 05:51:55 [DEBUG   ] summary = ERROR
2019-03-22 05:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99947  13 58564 21115375 A  ERRORERROR'
2019-03-22 05:51:55 [DEBUG   ] Got command RPT from MCS: ref #99948
2019-03-22 05:51:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99948  77 58564 21115579 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:51:55 [DEBUG   ] Got command RPT from MCS: ref #99949
2019-03-22 05:51:55 [DEBUG   ] summary = ERROR
2019-03-22 05:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99949  13 58564 21115783 A  ERRORERROR'
2019-03-22 05:51:55 [DEBUG   ] Got command RPT from MCS: ref #99950
2019-03-22 05:51:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99950  77 58564 21115975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:51:56 [DEBUG   ] Got command RPT from MCS: ref #99951
2019-03-22 05:51:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99951  12 58564 21116179 A  ERRORB“™š'
2019-03-22 05:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:52:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:52:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:52:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:52:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:52:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:52:06 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-03-22 05:52:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:52:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:52:40 [DEBUG   ] Got command RPT from MCS: ref #99952
2019-03-22 05:52:40 [DEBUG   ] summary = ERROR
2019-03-22 05:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99952  13 58564 21160987 A  ERRORERROR'
2019-03-22 05:52:40 [DEBUG   ] Got command RPT from MCS: ref #99953
2019-03-22 05:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99953  77 58564 21160987 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:52:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:53:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:53:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:53:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:53:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:53:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:53:06 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-03-22 05:53:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:53:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:53:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:54:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 05:54:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:54:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:54:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:54:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:54:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:54:06 [DEBUG   ] Finished updating board flags in 1.147 seconds
2019-03-22 05:54:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:54:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:54:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:55:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:55:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:55:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:55:06 [WARNING ] (13, 1, 'bot')
2019-03-22 05:55:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:55:06 [DEBUG   ] Finished updating board flags in 1.037 seconds
2019-03-22 05:55:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 05:55:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:55:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 05:56:00 [DEBUG   ] Got command TBN from MCS: ref #99975
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-03-22 05:56:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    99975   8 58564 21360683 A  ERROR'
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1553234162']
2019-03-22 05:56:00 [DEBUG   ] spawn_process: at 2019-03-22 05:56:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1553234162']
2019-03-22 05:56:00 [INFO    ] Finished spawning TBN in 0.054 s
2019-03-22 05:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:56:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:56:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:56:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:56:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:56:07 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-03-22 05:56:08 [DEBUG   ] Finished updating ant stats in 1.268 seconds
2019-03-22 05:56:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-03-22 05:56:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 05:56:55 [DEBUG   ] Got command RPT from MCS: ref #99978
2019-03-22 05:56:55 [DEBUG   ] summary = ERROR
2019-03-22 05:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99978  13 58564 21415459 A  ERRORERROR'
2019-03-22 05:56:55 [DEBUG   ] Got command RPT from MCS: ref #99979
2019-03-22 05:56:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99979  77 58564 21415663 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:56:55 [DEBUG   ] Got command RPT from MCS: ref #99980
2019-03-22 05:56:55 [DEBUG   ] summary = ERROR
2019-03-22 05:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99980  13 58564 21415867 A  ERRORERROR'
2019-03-22 05:56:56 [DEBUG   ] Got command RPT from MCS: ref #99982
2019-03-22 05:56:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99982  77 58564 21416059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:56:56 [DEBUG   ] Got command RPT from MCS: ref #99983
2019-03-22 05:56:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 05:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99983  12 58564 21416263 A  ERRORB’™š'
2019-03-22 05:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:57:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:57:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:57:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:57:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:57:07 [DEBUG   ] Finished updating board flags in 1.848 seconds
2019-03-22 05:57:08 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 05:57:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 05:57:40 [DEBUG   ] Got command RPT from MCS: ref #99994
2019-03-22 05:57:40 [DEBUG   ] summary = ERROR
2019-03-22 05:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99994  13 58564 21460995 A  ERRORERROR'
2019-03-22 05:57:40 [DEBUG   ] Got command RPT from MCS: ref #99995
2019-03-22 05:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 05:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    99995  77 58564 21460995 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 05:57:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:58:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 05:58:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:58:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:58:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:58:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:58:07 [DEBUG   ] Finished updating board flags in 1.740 seconds
2019-03-22 05:58:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 05:58:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 05:58:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 05:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 05:59:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:59:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:59:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:59:07 [WARNING ] (13, 1, 'bot')
2019-03-22 05:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 05:59:07 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-03-22 05:59:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:59:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 05:59:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:00:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:00:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:00:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:00:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:00:07 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-03-22 06:00:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 06:00:11 [DEBUG   ] Got command TBW from MCS: ref #100018
2019-03-22 06:00:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-03-22 06:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   100018   8 58564 21611759 A  ERROR'
2019-03-22 06:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-03-22 06:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-03-22 06:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-03-22 06:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-03-22 06:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-03-22 06:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-03-22 06:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-03-22 06:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-03-22 06:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-03-22 06:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-03-22 06:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-03-22 06:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-03-22 06:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-03-22 06:00:15 [DEBUG   ] spawn_process: at 2019-03-22 06:00:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-03-22 06:00:15 [INFO    ] Finished spawning TBW
2019-03-22 06:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:01:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:01:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:01:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:01:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:01:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:01:07 [DEBUG   ] Finished updating board flags in 1.242 seconds
2019-03-22 06:01:55 [DEBUG   ] Got command RPT from MCS: ref #100023
2019-03-22 06:01:55 [DEBUG   ] summary = ERROR
2019-03-22 06:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100023  13 58564 21715551 A  ERRORERROR'
2019-03-22 06:01:55 [DEBUG   ] Got command RPT from MCS: ref #100024
2019-03-22 06:01:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100024  77 58564 21715755 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:01:55 [DEBUG   ] Got command RPT from MCS: ref #100025
2019-03-22 06:01:55 [DEBUG   ] summary = ERROR
2019-03-22 06:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100025  13 58564 21715947 A  ERRORERROR'
2019-03-22 06:01:56 [DEBUG   ] Got command RPT from MCS: ref #100026
2019-03-22 06:01:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100026  77 58564 21716151 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:01:56 [DEBUG   ] Got command RPT from MCS: ref #100027
2019-03-22 06:01:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100027  12 58564 21716355 A  ERRORB’™š'
2019-03-22 06:02:03 [INFO    ] __waitForTBW - TBW finished in 108.631 s
2019-03-22 06:02:04 [DEBUG   ] Finished updating ant stats in 0.378 seconds
2019-03-22 06:02:04 [INFO    ] Started antennas statistics background thread
2019-03-22 06:02:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1553234526']
2019-03-22 06:02:04 [DEBUG   ] spawn_process: at 2019-03-22 06:02:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1553234526']
2019-03-22 06:02:04 [INFO    ] Finished spawning TBN in 0.055 s
2019-03-22 06:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:02:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:02:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:02:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:02:07 [WARNING ] (13, 1, 'bot')
2019-03-22 06:02:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:02:07 [DEBUG   ] Finished updating board flags in 1.133 seconds
2019-03-22 06:02:25 [DEBUG   ] Finished updating ant stats in 1.269 seconds
2019-03-22 06:02:40 [DEBUG   ] Got command RPT from MCS: ref #100029
2019-03-22 06:02:40 [DEBUG   ] summary = ERROR
2019-03-22 06:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100029  13 58564 21760991 A  ERRORERROR'
2019-03-22 06:02:40 [DEBUG   ] Got command RPT from MCS: ref #100030
2019-03-22 06:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100030  77 58564 21760991 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:02:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 06:03:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:03:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 06:03:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:03:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:03:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:03:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:03:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:03:08 [DEBUG   ] Finished updating board flags in 2.202 seconds
2019-03-22 06:03:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:03:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:04:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:04:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:04:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:04:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:04:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:04:08 [DEBUG   ] Finished updating board flags in 2.234 seconds
2019-03-22 06:04:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:04:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:05:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 06:05:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:05:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:05:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:05:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:05:08 [DEBUG   ] Finished updating board flags in 2.239 seconds
2019-03-22 06:05:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-03-22 06:05:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 06:06:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 06:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:06:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:06:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:06:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:06:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:06:08 [DEBUG   ] Finished updating board flags in 2.114 seconds
2019-03-22 06:06:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 06:06:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 06:06:55 [DEBUG   ] Got command RPT from MCS: ref #100062
2019-03-22 06:06:55 [DEBUG   ] summary = ERROR
2019-03-22 06:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100062  13 58564 22015639 A  ERRORERROR'
2019-03-22 06:06:55 [DEBUG   ] Got command RPT from MCS: ref #100063
2019-03-22 06:06:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100063  77 58564 22015843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:06:56 [DEBUG   ] Got command RPT from MCS: ref #100064
2019-03-22 06:06:56 [DEBUG   ] summary = ERROR
2019-03-22 06:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100064  13 58564 22016035 A  ERRORERROR'
2019-03-22 06:06:56 [DEBUG   ] Got command RPT from MCS: ref #100066
2019-03-22 06:06:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100066  77 58564 22016239 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:06:56 [DEBUG   ] Got command RPT from MCS: ref #100067
2019-03-22 06:06:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100067  12 58564 22016443 A  ERRORB’™š'
2019-03-22 06:07:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 06:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:07:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:07:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:07:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:07:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:07:08 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-03-22 06:07:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 06:07:40 [DEBUG   ] Got command RPT from MCS: ref #100072
2019-03-22 06:07:40 [DEBUG   ] summary = ERROR
2019-03-22 06:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100072  13 58564 22060995 A  ERRORERROR'
2019-03-22 06:07:40 [DEBUG   ] Got command RPT from MCS: ref #100073
2019-03-22 06:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100073  77 58564 22060995 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:07:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 06:08:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 06:08:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-03-22 06:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:08:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:08:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:08:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:08:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:08:08 [DEBUG   ] Finished updating board flags in 2.050 seconds
2019-03-22 06:08:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 06:08:45 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 06:09:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 06:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:09:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:09:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:09:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:09:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:09:08 [DEBUG   ] Finished updating board flags in 1.952 seconds
2019-03-22 06:09:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 06:09:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 06:10:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:10:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:10:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:10:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:10:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:10:08 [DEBUG   ] Finished updating board flags in 1.843 seconds
2019-03-22 06:10:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:10:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 06:11:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 06:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:11:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:11:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:11:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:11:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:11:08 [DEBUG   ] Finished updating board flags in 1.762 seconds
2019-03-22 06:11:25 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2019-03-22 06:11:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 06:11:55 [DEBUG   ] Got command RPT from MCS: ref #100095
2019-03-22 06:11:55 [DEBUG   ] summary = ERROR
2019-03-22 06:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100095  13 58564 22315723 A  ERRORERROR'
2019-03-22 06:11:55 [DEBUG   ] Got command RPT from MCS: ref #100096
2019-03-22 06:11:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100096  77 58564 22315927 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:11:56 [DEBUG   ] Got command RPT from MCS: ref #100097
2019-03-22 06:11:56 [DEBUG   ] summary = ERROR
2019-03-22 06:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100097  13 58564 22316119 A  ERRORERROR'
2019-03-22 06:11:56 [DEBUG   ] Got command RPT from MCS: ref #100098
2019-03-22 06:11:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100098  77 58564 22316323 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:11:56 [DEBUG   ] Got command RPT from MCS: ref #100099
2019-03-22 06:11:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100099  12 58564 22316527 A  ERRORB”™š'
2019-03-22 06:12:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 06:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:12:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:12:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:12:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:12:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:12:08 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-03-22 06:12:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 06:12:40 [DEBUG   ] Got command RPT from MCS: ref #100106
2019-03-22 06:12:40 [DEBUG   ] summary = ERROR
2019-03-22 06:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100106  13 58564 22360999 A  ERRORERROR'
2019-03-22 06:12:40 [DEBUG   ] Got command RPT from MCS: ref #100107
2019-03-22 06:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100107  77 58564 22360999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:12:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:13:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 06:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:13:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:13:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:13:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:13:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:13:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:13:08 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-03-22 06:13:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:13:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:14:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:14:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:14:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:14:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:14:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:14:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:14:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:14:08 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-03-22 06:14:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 06:14:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:15:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:15:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:15:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:15:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:15:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:15:08 [WARNING ] (13, 1, 'bot')
2019-03-22 06:15:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:15:08 [DEBUG   ] Finished updating board flags in 1.475 seconds
2019-03-22 06:15:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 06:15:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 06:16:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:16:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-03-22 06:16:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:16:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:16:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:16:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:16:09 [WARNING ] (25, 5, 'bot')
2019-03-22 06:16:09 [WARNING ] (25, 5, 'bot')
2019-03-22 06:16:09 [WARNING ] (25, 5, 'bot')
2019-03-22 06:16:09 [WARNING ] (25, 5, 'bot')
2019-03-22 06:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:16:09 [DEBUG   ] Finished updating board flags in 2.366 seconds
2019-03-22 06:16:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:16:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 06:16:55 [DEBUG   ] Got command RPT from MCS: ref #100131
2019-03-22 06:16:55 [DEBUG   ] summary = ERROR
2019-03-22 06:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100131  13 58564 22615803 A  ERRORERROR'
2019-03-22 06:16:56 [DEBUG   ] Got command RPT from MCS: ref #100132
2019-03-22 06:16:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100132  77 58564 22616007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:16:56 [DEBUG   ] Got command RPT from MCS: ref #100133
2019-03-22 06:16:56 [DEBUG   ] summary = ERROR
2019-03-22 06:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100133  13 58564 22616211 A  ERRORERROR'
2019-03-22 06:16:56 [DEBUG   ] Got command RPT from MCS: ref #100135
2019-03-22 06:16:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100135  77 58564 22616415 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:16:56 [DEBUG   ] Got command RPT from MCS: ref #100137
2019-03-22 06:16:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100137  12 58564 22616607 A  ERRORB”™š'
2019-03-22 06:17:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-03-22 06:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 06:17:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:17:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:17:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:17:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:17:09 [DEBUG   ] Finished updating board flags in 2.120 seconds
2019-03-22 06:17:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:17:40 [DEBUG   ] Got command RPT from MCS: ref #100141
2019-03-22 06:17:40 [DEBUG   ] summary = ERROR
2019-03-22 06:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100141  13 58564 22660999 A  ERRORERROR'
2019-03-22 06:17:40 [DEBUG   ] Got command RPT from MCS: ref #100142
2019-03-22 06:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100142  77 58564 22660999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:17:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:18:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 06:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:18:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:18:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:18:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:18:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:18:09 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-03-22 06:18:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 06:18:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:19:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:19:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:19:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:19:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:19:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:19:09 [DEBUG   ] Finished updating board flags in 2.046 seconds
2019-03-22 06:19:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 06:19:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 06:20:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:20:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:20:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:20:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:20:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:20:09 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-03-22 06:20:26 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-22 06:20:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 06:21:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 06:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:21:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:21:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:21:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:21:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:21:09 [DEBUG   ] Finished updating board flags in 1.917 seconds
2019-03-22 06:21:26 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-03-22 06:21:47 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 06:21:55 [DEBUG   ] Got command RPT from MCS: ref #100170
2019-03-22 06:21:55 [DEBUG   ] summary = ERROR
2019-03-22 06:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100170  13 58564 22915899 A  ERRORERROR'
2019-03-22 06:21:56 [DEBUG   ] Got command RPT from MCS: ref #100171
2019-03-22 06:21:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100171  77 58564 22916091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:21:56 [DEBUG   ] Got command RPT from MCS: ref #100172
2019-03-22 06:21:56 [DEBUG   ] summary = ERROR
2019-03-22 06:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100172  13 58564 22916295 A  ERRORERROR'
2019-03-22 06:21:56 [DEBUG   ] Got command RPT from MCS: ref #100173
2019-03-22 06:21:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100173  77 58564 22916499 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:21:56 [DEBUG   ] Got command RPT from MCS: ref #100174
2019-03-22 06:21:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100174  12 58564 22916691 A  ERRORB“™š'
2019-03-22 06:22:07 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 06:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:22:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:22:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:22:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:22:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:22:09 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-03-22 06:22:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 06:22:41 [DEBUG   ] Got command RPT from MCS: ref #100175
2019-03-22 06:22:41 [DEBUG   ] summary = ERROR
2019-03-22 06:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100175  13 58564 22961003 A  ERRORERROR'
2019-03-22 06:22:41 [DEBUG   ] Got command RPT from MCS: ref #100176
2019-03-22 06:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100176  77 58564 22961003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:22:47 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 06:23:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 06:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:23:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:23:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:23:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:23:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:23:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:23:09 [DEBUG   ] Finished updating board flags in 1.779 seconds
2019-03-22 06:23:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:23:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 06:24:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 06:24:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:24:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:24:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:24:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:24:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:24:09 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-03-22 06:24:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 06:24:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 06:25:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 06:25:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:25:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 06:25:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:25:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:25:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:25:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:25:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:25:09 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-03-22 06:25:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 06:25:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 06:26:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 06:26:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:26:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:26:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:26:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:26:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:26:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:26:09 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-03-22 06:26:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 06:26:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 06:26:55 [DEBUG   ] Got command RPT from MCS: ref #100200
2019-03-22 06:26:55 [DEBUG   ] summary = ERROR
2019-03-22 06:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100200  13 58564 23215975 A  ERRORERROR'
2019-03-22 06:26:56 [DEBUG   ] Got command RPT from MCS: ref #100201
2019-03-22 06:26:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100201  77 58564 23216179 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:26:56 [DEBUG   ] Got command RPT from MCS: ref #100202
2019-03-22 06:26:56 [DEBUG   ] summary = ERROR
2019-03-22 06:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100202  13 58564 23216383 A  ERRORERROR'
2019-03-22 06:26:56 [DEBUG   ] Got command RPT from MCS: ref #100204
2019-03-22 06:26:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100204  77 58564 23216575 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:26:56 [DEBUG   ] Got command RPT from MCS: ref #100205
2019-03-22 06:26:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100205  12 58564 23216779 A  ERRORB“™š'
2019-03-22 06:27:08 [DEBUG   ] Finished updating ant stats in 1.255 seconds
2019-03-22 06:27:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:27:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:27:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:27:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:27:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:27:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:27:09 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-03-22 06:27:28 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2019-03-22 06:27:40 [DEBUG   ] Got command RPT from MCS: ref #100216
2019-03-22 06:27:40 [DEBUG   ] summary = ERROR
2019-03-22 06:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100216  13 58564 23260999 A  ERRORERROR'
2019-03-22 06:27:40 [DEBUG   ] Got command RPT from MCS: ref #100217
2019-03-22 06:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100217  77 58564 23260999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:27:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 06:28:08 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2019-03-22 06:28:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:28:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:28:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:28:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:28:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:28:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:28:09 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-03-22 06:28:28 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2019-03-22 06:28:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 06:29:08 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2019-03-22 06:29:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:29:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:29:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:29:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:29:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:29:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:29:09 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-03-22 06:29:28 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2019-03-22 06:29:49 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-03-22 06:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:30:09 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2019-03-22 06:30:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 06:30:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:30:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:30:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:30:09 [WARNING ] (13, 1, 'bot')
2019-03-22 06:30:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:30:09 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-03-22 06:30:29 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2019-03-22 06:30:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 06:31:09 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2019-03-22 06:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:31:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:31:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:31:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:31:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:31:10 [DEBUG   ] Finished updating board flags in 2.178 seconds
2019-03-22 06:31:29 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2019-03-22 06:31:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 06:31:56 [DEBUG   ] Got command RPT from MCS: ref #100239
2019-03-22 06:31:56 [DEBUG   ] summary = ERROR
2019-03-22 06:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100239  13 58564 23516063 A  ERRORERROR'
2019-03-22 06:31:56 [DEBUG   ] Got command RPT from MCS: ref #100240
2019-03-22 06:31:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100240  77 58564 23516267 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:31:56 [DEBUG   ] Got command RPT from MCS: ref #100241
2019-03-22 06:31:56 [DEBUG   ] summary = ERROR
2019-03-22 06:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100241  13 58564 23516471 A  ERRORERROR'
2019-03-22 06:31:56 [DEBUG   ] Got command RPT from MCS: ref #100242
2019-03-22 06:31:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100242  77 58564 23516663 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:31:56 [DEBUG   ] Got command RPT from MCS: ref #100243
2019-03-22 06:31:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100243  12 58564 23516867 A  ERRORB’™š'
2019-03-22 06:32:09 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2019-03-22 06:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:32:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:32:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:32:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:32:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:32:10 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-03-22 06:32:29 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2019-03-22 06:32:41 [DEBUG   ] Got command RPT from MCS: ref #100244
2019-03-22 06:32:41 [DEBUG   ] summary = ERROR
2019-03-22 06:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100244  13 58564 23561003 A  ERRORERROR'
2019-03-22 06:32:41 [DEBUG   ] Got command RPT from MCS: ref #100245
2019-03-22 06:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100245  77 58564 23561003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:32:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 06:33:09 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2019-03-22 06:33:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:33:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:33:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:33:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:33:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:33:10 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-03-22 06:33:29 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2019-03-22 06:33:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 06:34:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:34:10 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2019-03-22 06:34:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:34:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:34:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:34:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:34:10 [DEBUG   ] Finished updating board flags in 1.864 seconds
2019-03-22 06:34:30 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2019-03-22 06:34:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 06:35:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:35:10 [DEBUG   ] Finished updating ant stats in 1.039 seconds
2019-03-22 06:35:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:35:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:35:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:35:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:35:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:35:10 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-03-22 06:35:30 [DEBUG   ] Finished updating ant stats in 0.962 seconds
2019-03-22 06:35:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 06:36:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:36:10 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2019-03-22 06:36:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:36:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:36:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:36:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:36:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:36:10 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-03-22 06:36:30 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2019-03-22 06:36:51 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-03-22 06:36:56 [DEBUG   ] Got command RPT from MCS: ref #100275
2019-03-22 06:36:56 [DEBUG   ] summary = ERROR
2019-03-22 06:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100275  13 58564 23816155 A  ERRORERROR'
2019-03-22 06:36:56 [DEBUG   ] Got command RPT from MCS: ref #100276
2019-03-22 06:36:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100276  77 58564 23816359 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:36:56 [DEBUG   ] Got command RPT from MCS: ref #100277
2019-03-22 06:36:56 [DEBUG   ] summary = ERROR
2019-03-22 06:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100277  13 58564 23816551 A  ERRORERROR'
2019-03-22 06:36:56 [DEBUG   ] Got command RPT from MCS: ref #100279
2019-03-22 06:36:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100279  77 58564 23816755 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:36:56 [DEBUG   ] Got command RPT from MCS: ref #100280
2019-03-22 06:36:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100280  12 58564 23816959 A  ERRORB’™š'
2019-03-22 06:37:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:37:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 06:37:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:37:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:37:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:37:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:37:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:37:10 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-03-22 06:37:11 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-03-22 06:37:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 06:37:41 [DEBUG   ] Got command RPT from MCS: ref #100285
2019-03-22 06:37:41 [DEBUG   ] summary = ERROR
2019-03-22 06:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100285  13 58564 23861003 A  ERRORERROR'
2019-03-22 06:37:41 [DEBUG   ] Got command RPT from MCS: ref #100286
2019-03-22 06:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100286  77 58564 23861003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:37:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:38:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:38:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:38:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:38:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:38:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:38:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:38:10 [DEBUG   ] Finished updating board flags in 1.457 seconds
2019-03-22 06:38:11 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-03-22 06:38:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 06:38:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 06:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:39:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:39:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:39:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:39:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:39:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:39:10 [DEBUG   ] Finished updating board flags in 1.454 seconds
2019-03-22 06:39:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 06:39:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:39:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 06:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:40:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:40:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:40:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:40:10 [WARNING ] (13, 1, 'bot')
2019-03-22 06:40:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:40:10 [DEBUG   ] Finished updating board flags in 1.487 seconds
2019-03-22 06:40:11 [DEBUG   ] Finished updating ant stats in 0.610 seconds
2019-03-22 06:40:31 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2019-03-22 06:40:52 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 06:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:41:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 06:41:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:41:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:41:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:41:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:41:11 [DEBUG   ] Finished updating board flags in 2.216 seconds
2019-03-22 06:41:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-22 06:41:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:41:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:41:56 [DEBUG   ] Got command RPT from MCS: ref #100308
2019-03-22 06:41:56 [DEBUG   ] summary = ERROR
2019-03-22 06:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100308  13 58564 24116243 A  ERRORERROR'
2019-03-22 06:41:56 [DEBUG   ] Got command RPT from MCS: ref #100309
2019-03-22 06:41:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100309  77 58564 24116435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:41:56 [DEBUG   ] Got command RPT from MCS: ref #100310
2019-03-22 06:41:56 [DEBUG   ] summary = ERROR
2019-03-22 06:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100310  13 58564 24116639 A  ERRORERROR'
2019-03-22 06:41:56 [DEBUG   ] Got command RPT from MCS: ref #100311
2019-03-22 06:41:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100311  77 58564 24116843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:41:57 [DEBUG   ] Got command RPT from MCS: ref #100312
2019-03-22 06:41:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100312  12 58564 24117047 A  ERRORB‘™š'
2019-03-22 06:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:42:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:42:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:42:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:42:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:42:11 [DEBUG   ] Finished updating board flags in 2.194 seconds
2019-03-22 06:42:12 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 06:42:32 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-03-22 06:42:40 [DEBUG   ] Got command RPT from MCS: ref #100319
2019-03-22 06:42:40 [DEBUG   ] summary = ERROR
2019-03-22 06:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100319  13 58564 24160999 A  ERRORERROR'
2019-03-22 06:42:40 [DEBUG   ] Got command RPT from MCS: ref #100320
2019-03-22 06:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100320  77 58564 24160999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:42:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:43:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:43:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:43:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:43:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:43:11 [DEBUG   ] Finished updating board flags in 2.017 seconds
2019-03-22 06:43:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:43:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 06:43:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 06:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:44:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:44:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:44:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:44:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:44:11 [DEBUG   ] Finished updating board flags in 1.955 seconds
2019-03-22 06:44:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 06:44:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 06:44:53 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-03-22 06:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:45:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:45:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:45:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:45:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:45:11 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-03-22 06:45:12 [DEBUG   ] Finished updating ant stats in 0.438 seconds
2019-03-22 06:45:33 [DEBUG   ] Finished updating ant stats in 1.367 seconds
2019-03-22 06:45:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 06:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:46:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:46:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:46:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:46:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:46:11 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-03-22 06:46:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:46:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 06:46:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:46:56 [DEBUG   ] Got command RPT from MCS: ref #100344
2019-03-22 06:46:56 [DEBUG   ] summary = ERROR
2019-03-22 06:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100344  13 58564 24416323 A  ERRORERROR'
2019-03-22 06:46:56 [DEBUG   ] Got command RPT from MCS: ref #100345
2019-03-22 06:46:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100345  77 58564 24416527 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:46:56 [DEBUG   ] Got command RPT from MCS: ref #100346
2019-03-22 06:46:56 [DEBUG   ] summary = ERROR
2019-03-22 06:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100346  13 58564 24416731 A  ERRORERROR'
2019-03-22 06:46:56 [DEBUG   ] Got command RPT from MCS: ref #100348
2019-03-22 06:46:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100348  77 58564 24416923 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:46:57 [DEBUG   ] Got command RPT from MCS: ref #100349
2019-03-22 06:46:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100349  12 58564 24417127 A  ERRORB”™š'
2019-03-22 06:47:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:47:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:47:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:47:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:47:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:47:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:47:11 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-03-22 06:47:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 06:47:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 06:47:40 [DEBUG   ] Got command RPT from MCS: ref #100354
2019-03-22 06:47:40 [DEBUG   ] summary = ERROR
2019-03-22 06:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100354  13 58564 24460999 A  ERRORERROR'
2019-03-22 06:47:40 [DEBUG   ] Got command RPT from MCS: ref #100355
2019-03-22 06:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100355  77 58564 24460999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:47:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 06:48:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:48:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:48:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:48:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:48:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:48:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:48:11 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-03-22 06:48:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 06:48:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 06:48:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 06:49:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:49:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:49:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:49:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:49:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:49:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:49:11 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-03-22 06:49:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 06:49:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 06:49:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 06:50:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 06:50:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:50:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:50:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:50:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:50:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:50:11 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-03-22 06:50:13 [DEBUG   ] Finished updating ant stats in 0.831 seconds
2019-03-22 06:50:34 [DEBUG   ] Finished updating ant stats in 1.572 seconds
2019-03-22 06:50:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 06:51:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:51:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 06:51:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:51:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:51:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:51:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:51:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:51:11 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-03-22 06:51:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-22 06:51:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 06:51:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 06:51:56 [DEBUG   ] Got command RPT from MCS: ref #100383
2019-03-22 06:51:56 [DEBUG   ] summary = ERROR
2019-03-22 06:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100383  13 58564 24716411 A  ERRORERROR'
2019-03-22 06:51:56 [DEBUG   ] Got command RPT from MCS: ref #100384
2019-03-22 06:51:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100384  77 58564 24716615 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:51:56 [DEBUG   ] Got command RPT from MCS: ref #100385
2019-03-22 06:51:56 [DEBUG   ] summary = ERROR
2019-03-22 06:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100385  13 58564 24716819 A  ERRORERROR'
2019-03-22 06:51:57 [DEBUG   ] Got command RPT from MCS: ref #100386
2019-03-22 06:51:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100386  77 58564 24717011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:51:57 [DEBUG   ] Got command RPT from MCS: ref #100387
2019-03-22 06:51:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100387  12 58564 24717215 A  ERRORB”™š'
2019-03-22 06:52:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:52:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:52:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:52:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:52:11 [WARNING ] (13, 1, 'bot')
2019-03-22 06:52:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:52:11 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-03-22 06:52:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 06:52:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 06:52:41 [DEBUG   ] Got command RPT from MCS: ref #100388
2019-03-22 06:52:41 [DEBUG   ] summary = ERROR
2019-03-22 06:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100388  13 58564 24761003 A  ERRORERROR'
2019-03-22 06:52:41 [DEBUG   ] Got command RPT from MCS: ref #100389
2019-03-22 06:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100389  77 58564 24761003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:52:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:53:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:53:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:53:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:53:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:53:12 [DEBUG   ] Finished updating board flags in 2.197 seconds
2019-03-22 06:53:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 06:53:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 06:53:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 06:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:54:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:54:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:54:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:54:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:54:12 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-03-22 06:54:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 06:54:35 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 06:54:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 06:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:55:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:55:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:55:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:55:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:55:12 [DEBUG   ] Finished updating board flags in 2.181 seconds
2019-03-22 06:55:15 [DEBUG   ] Finished updating ant stats in 1.516 seconds
2019-03-22 06:55:35 [DEBUG   ] Finished updating ant stats in 1.083 seconds
2019-03-22 06:55:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 06:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:56:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:56:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:56:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:56:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:56:12 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-03-22 06:56:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 06:56:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 06:56:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 06:56:56 [DEBUG   ] Got command RPT from MCS: ref #100413
2019-03-22 06:56:56 [DEBUG   ] summary = ERROR
2019-03-22 06:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100413  13 58564 25016491 A  ERRORERROR'
2019-03-22 06:56:56 [DEBUG   ] Got command RPT from MCS: ref #100414
2019-03-22 06:56:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100414  77 58564 25016695 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:56:56 [DEBUG   ] Got command RPT from MCS: ref #100415
2019-03-22 06:56:56 [DEBUG   ] summary = ERROR
2019-03-22 06:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100415  13 58564 25016899 A  ERRORERROR'
2019-03-22 06:56:57 [DEBUG   ] Got command RPT from MCS: ref #100417
2019-03-22 06:56:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100417  77 58564 25017103 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:56:57 [DEBUG   ] Got command RPT from MCS: ref #100418
2019-03-22 06:56:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 06:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100418  12 58564 25017295 A  ERRORB“™š'
2019-03-22 06:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:57:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 06:57:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:57:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:57:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:57:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:57:12 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-03-22 06:57:15 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 06:57:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 06:57:41 [DEBUG   ] Got command RPT from MCS: ref #100429
2019-03-22 06:57:41 [DEBUG   ] summary = ERROR
2019-03-22 06:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100429  13 58564 25061003 A  ERRORERROR'
2019-03-22 06:57:41 [DEBUG   ] Got command RPT from MCS: ref #100430
2019-03-22 06:57:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 06:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100430  77 58564 25061003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 06:57:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 06:58:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:58:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:58:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:58:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:58:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:58:12 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-03-22 06:58:15 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-03-22 06:58:36 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 06:58:56 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 06:59:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 06:59:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:59:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:59:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:59:12 [WARNING ] (13, 1, 'bot')
2019-03-22 06:59:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 06:59:12 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-03-22 06:59:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-03-22 06:59:36 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 06:59:56 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 07:00:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:00:12 [WARNING ] (13, 1, 'bot')
2019-03-22 07:00:12 [WARNING ] (13, 1, 'bot')
2019-03-22 07:00:12 [WARNING ] (13, 1, 'bot')
2019-03-22 07:00:12 [WARNING ] (13, 1, 'bot')
2019-03-22 07:00:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:00:12 [DEBUG   ] Finished updating board flags in 1.538 seconds
2019-03-22 07:00:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 07:00:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 07:00:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 07:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:01:12 [WARNING ] (13, 1, 'bot')
2019-03-22 07:01:12 [WARNING ] (13, 1, 'bot')
2019-03-22 07:01:12 [WARNING ] (13, 1, 'bot')
2019-03-22 07:01:12 [WARNING ] (13, 1, 'bot')
2019-03-22 07:01:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:01:12 [DEBUG   ] Finished updating board flags in 1.517 seconds
2019-03-22 07:01:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 07:01:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 07:01:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 07:01:56 [DEBUG   ] Got command RPT from MCS: ref #100452
2019-03-22 07:01:56 [DEBUG   ] summary = ERROR
2019-03-22 07:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100452  13 58564 25316583 A  ERRORERROR'
2019-03-22 07:01:56 [DEBUG   ] Got command RPT from MCS: ref #100453
2019-03-22 07:01:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100453  77 58564 25316787 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:01:56 [DEBUG   ] Got command RPT from MCS: ref #100454
2019-03-22 07:01:56 [DEBUG   ] summary = ERROR
2019-03-22 07:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100454  13 58564 25316979 A  ERRORERROR'
2019-03-22 07:01:57 [DEBUG   ] Got command RPT from MCS: ref #100455
2019-03-22 07:01:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:01:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100455  77 58564 25317183 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:01:57 [DEBUG   ] Got command RPT from MCS: ref #100456
2019-03-22 07:01:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:01:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100456  12 58564 25317387 A  ERRORB’™š'
2019-03-22 07:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:02:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:02:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:02:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:02:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:02:13 [DEBUG   ] Finished updating board flags in 2.256 seconds
2019-03-22 07:02:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 07:02:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 07:02:41 [DEBUG   ] Got command RPT from MCS: ref #100457
2019-03-22 07:02:41 [DEBUG   ] summary = ERROR
2019-03-22 07:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100457  13 58564 25361007 A  ERRORERROR'
2019-03-22 07:02:41 [DEBUG   ] Got command RPT from MCS: ref #100458
2019-03-22 07:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100458  77 58564 25361007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:02:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 07:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 07:03:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:03:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:03:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:03:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:03:13 [DEBUG   ] Finished updating board flags in 2.090 seconds
2019-03-22 07:03:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 07:03:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 07:03:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:04:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:04:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:04:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:04:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:04:13 [DEBUG   ] Finished updating board flags in 2.027 seconds
2019-03-22 07:04:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:04:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 07:04:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 07:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:05:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:05:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:05:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:05:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:05:13 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-03-22 07:05:16 [DEBUG   ] Finished updating ant stats in 0.927 seconds
2019-03-22 07:05:36 [DEBUG   ] Finished updating ant stats in 0.476 seconds
2019-03-22 07:05:57 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 07:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:06:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:06:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:06:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:06:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:06:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:06:13 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-03-22 07:06:17 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 07:06:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 07:06:56 [DEBUG   ] Got command RPT from MCS: ref #100488
2019-03-22 07:06:56 [DEBUG   ] summary = ERROR
2019-03-22 07:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100488  13 58564 25616667 A  ERRORERROR'
2019-03-22 07:06:56 [DEBUG   ] Got command RPT from MCS: ref #100489
2019-03-22 07:06:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100489  77 58564 25616871 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:06:57 [DEBUG   ] Got command RPT from MCS: ref #100490
2019-03-22 07:06:57 [DEBUG   ] summary = ERROR
2019-03-22 07:06:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100490  13 58564 25617063 A  ERRORERROR'
2019-03-22 07:06:57 [DEBUG   ] Got command RPT from MCS: ref #100492
2019-03-22 07:06:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:06:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100492  77 58564 25617267 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:06:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 07:06:57 [DEBUG   ] Got command RPT from MCS: ref #100493
2019-03-22 07:06:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:06:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100493  12 58564 25617471 A  ERRORB’™š'
2019-03-22 07:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:07:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:07:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:07:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:07:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:07:13 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-03-22 07:07:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-22 07:07:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 07:07:41 [DEBUG   ] Got command RPT from MCS: ref #100498
2019-03-22 07:07:41 [DEBUG   ] summary = ERROR
2019-03-22 07:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100498  13 58564 25661011 A  ERRORERROR'
2019-03-22 07:07:41 [DEBUG   ] Got command RPT from MCS: ref #100499
2019-03-22 07:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100499  77 58564 25661011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:07:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 07:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:08:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:08:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:08:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:08:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:08:13 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-03-22 07:08:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 07:08:37 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-03-22 07:08:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 07:09:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:09:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:09:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:09:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:09:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:09:13 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-03-22 07:09:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 07:09:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 07:09:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 07:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:10:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:10:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:10:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:10:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:10:13 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-03-22 07:10:17 [DEBUG   ] Finished updating ant stats in 1.018 seconds
2019-03-22 07:10:37 [DEBUG   ] Finished updating ant stats in 0.783 seconds
2019-03-22 07:10:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 07:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:11:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:11:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:11:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:11:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:11:13 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-03-22 07:11:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 07:11:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 07:11:56 [DEBUG   ] Got command RPT from MCS: ref #100521
2019-03-22 07:11:56 [DEBUG   ] summary = ERROR
2019-03-22 07:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100521  13 58564 25916751 A  ERRORERROR'
2019-03-22 07:11:56 [DEBUG   ] Got command RPT from MCS: ref #100522
2019-03-22 07:11:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100522  77 58564 25916959 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:11:57 [DEBUG   ] Got command RPT from MCS: ref #100523
2019-03-22 07:11:57 [DEBUG   ] summary = ERROR
2019-03-22 07:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100523  13 58564 25917155 A  ERRORERROR'
2019-03-22 07:11:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 07:11:57 [DEBUG   ] Got command RPT from MCS: ref #100524
2019-03-22 07:11:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100524  77 58564 25917359 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:11:57 [DEBUG   ] Got command RPT from MCS: ref #100525
2019-03-22 07:11:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100525  12 58564 25917551 A  ERRORB‘™š'
2019-03-22 07:12:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:12:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:12:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:12:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:12:13 [WARNING ] (13, 1, 'bot')
2019-03-22 07:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:12:13 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-03-22 07:12:18 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 07:12:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 07:12:41 [DEBUG   ] Got command RPT from MCS: ref #100532
2019-03-22 07:12:41 [DEBUG   ] summary = ERROR
2019-03-22 07:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100532  13 58564 25961007 A  ERRORERROR'
2019-03-22 07:12:41 [DEBUG   ] Got command RPT from MCS: ref #100533
2019-03-22 07:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100533  77 58564 25961007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:12:58 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 07:13:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:13:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:13:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:13:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:13:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:13:14 [DEBUG   ] Finished updating board flags in 2.039 seconds
2019-03-22 07:13:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 07:13:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 07:13:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 07:14:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:14:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:14:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:14:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:14:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:14:14 [DEBUG   ] Finished updating board flags in 1.975 seconds
2019-03-22 07:14:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 07:14:38 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 07:14:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 07:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:15:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:15:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:15:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:15:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:15:14 [DEBUG   ] Finished updating board flags in 1.830 seconds
2019-03-22 07:15:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 07:15:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 07:15:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:16:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:16:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:16:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:16:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:16:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:16:14 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-03-22 07:16:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 07:16:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:16:56 [DEBUG   ] Got command RPT from MCS: ref #100557
2019-03-22 07:16:56 [DEBUG   ] summary = ERROR
2019-03-22 07:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100557  13 58564 26216831 A  ERRORERROR'
2019-03-22 07:16:57 [DEBUG   ] Got command RPT from MCS: ref #100558
2019-03-22 07:16:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100558  77 58564 26217035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:16:57 [DEBUG   ] Got command RPT from MCS: ref #100559
2019-03-22 07:16:57 [DEBUG   ] summary = ERROR
2019-03-22 07:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100559  13 58564 26217239 A  ERRORERROR'
2019-03-22 07:16:57 [DEBUG   ] Got command RPT from MCS: ref #100561
2019-03-22 07:16:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100561  77 58564 26217443 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:16:57 [DEBUG   ] Got command RPT from MCS: ref #100563
2019-03-22 07:16:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100563  12 58564 26217635 A  ERRORB”™š'
2019-03-22 07:16:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 07:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 07:17:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:17:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:17:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:17:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:17:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:17:14 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-03-22 07:17:18 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 07:17:39 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-03-22 07:17:41 [DEBUG   ] Got command RPT from MCS: ref #100567
2019-03-22 07:17:41 [DEBUG   ] summary = ERROR
2019-03-22 07:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100567  13 58564 26261015 A  ERRORERROR'
2019-03-22 07:17:41 [DEBUG   ] Got command RPT from MCS: ref #100568
2019-03-22 07:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100568  77 58564 26261015 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:17:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 07:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2019-03-22 07:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:18:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:18:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:18:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:18:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:18:14 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-03-22 07:18:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 07:18:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 07:18:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 07:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 07:19:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:19:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:19:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:19:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:19:14 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-03-22 07:19:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 07:19:39 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-03-22 07:19:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 07:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:20:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:20:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:20:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:20:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:20:14 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-03-22 07:20:19 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-03-22 07:20:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 07:20:59 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 07:21:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:21:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:21:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:21:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:21:14 [WARNING ] (13, 1, 'bot')
2019-03-22 07:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:21:14 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-03-22 07:21:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 07:21:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 07:21:56 [DEBUG   ] Got command RPT from MCS: ref #100596
2019-03-22 07:21:56 [DEBUG   ] summary = ERROR
2019-03-22 07:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100596  13 58564 26516927 A  ERRORERROR'
2019-03-22 07:21:57 [DEBUG   ] Got command RPT from MCS: ref #100597
2019-03-22 07:21:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100597  77 58564 26517119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:21:57 [DEBUG   ] Got command RPT from MCS: ref #100598
2019-03-22 07:21:57 [DEBUG   ] summary = ERROR
2019-03-22 07:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100598  13 58564 26517323 A  ERRORERROR'
2019-03-22 07:21:57 [DEBUG   ] Got command RPT from MCS: ref #100599
2019-03-22 07:21:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100599  77 58564 26517527 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:21:57 [DEBUG   ] Got command RPT from MCS: ref #100600
2019-03-22 07:21:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100600  12 58564 26517731 A  ERRORB”™š'
2019-03-22 07:22:00 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 07:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:22:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:22:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:22:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:22:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:22:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:22:15 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-03-22 07:22:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 07:22:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 07:22:41 [DEBUG   ] Got command RPT from MCS: ref #100601
2019-03-22 07:22:41 [DEBUG   ] summary = ERROR
2019-03-22 07:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100601  13 58564 26561011 A  ERRORERROR'
2019-03-22 07:22:41 [DEBUG   ] Got command RPT from MCS: ref #100602
2019-03-22 07:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100602  77 58564 26561011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:23:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 07:23:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:23:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:23:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:23:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:23:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:23:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:23:15 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-03-22 07:23:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 07:23:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 07:24:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 07:24:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:24:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:24:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:24:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:24:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:24:15 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-03-22 07:24:20 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-03-22 07:24:40 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 07:25:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 07:25:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:25:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:25:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:25:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:25:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:25:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:25:15 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-03-22 07:25:21 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 07:25:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-22 07:26:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 07:26:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:26:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:26:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:26:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:26:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:26:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:26:15 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-03-22 07:26:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 07:26:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 07:26:57 [DEBUG   ] Got command RPT from MCS: ref #100626
2019-03-22 07:26:57 [DEBUG   ] summary = ERROR
2019-03-22 07:26:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100626  13 58564 26817007 A  ERRORERROR'
2019-03-22 07:26:57 [DEBUG   ] Got command RPT from MCS: ref #100627
2019-03-22 07:26:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:26:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100627  77 58564 26817211 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:26:57 [DEBUG   ] Got command RPT from MCS: ref #100628
2019-03-22 07:26:57 [DEBUG   ] summary = ERROR
2019-03-22 07:26:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100628  13 58564 26817415 A  ERRORERROR'
2019-03-22 07:26:57 [DEBUG   ] Got command RPT from MCS: ref #100630
2019-03-22 07:26:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:26:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100630  77 58564 26817607 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:26:57 [DEBUG   ] Got command RPT from MCS: ref #100632
2019-03-22 07:26:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:26:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100632  12 58564 26817811 A  ERRORB“™š'
2019-03-22 07:27:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-03-22 07:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:27:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:27:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:27:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:27:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:27:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:27:15 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-03-22 07:27:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 07:27:41 [DEBUG   ] Got command RPT from MCS: ref #100642
2019-03-22 07:27:41 [DEBUG   ] summary = ERROR
2019-03-22 07:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100642  13 58564 26861007 A  ERRORERROR'
2019-03-22 07:27:41 [DEBUG   ] Got command RPT from MCS: ref #100643
2019-03-22 07:27:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100643  77 58564 26861007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:27:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 07:28:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-03-22 07:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:28:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:28:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:28:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:28:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:28:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:28:15 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-03-22 07:28:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 07:28:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:29:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:29:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:29:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:29:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:29:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:29:15 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-03-22 07:29:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:29:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 07:30:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 07:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:30:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:30:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:30:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:30:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:30:15 [DEBUG   ] Finished updating board flags in 1.562 seconds
2019-03-22 07:30:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 07:30:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 07:31:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 07:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:31:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:31:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:31:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:31:15 [WARNING ] (13, 1, 'bot')
2019-03-22 07:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:31:15 [DEBUG   ] Finished updating board flags in 1.530 seconds
2019-03-22 07:31:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 07:31:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 07:31:57 [DEBUG   ] Got command RPT from MCS: ref #100665
2019-03-22 07:31:57 [DEBUG   ] summary = ERROR
2019-03-22 07:31:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100665  13 58564 27117095 A  ERRORERROR'
2019-03-22 07:31:57 [DEBUG   ] Got command RPT from MCS: ref #100666
2019-03-22 07:31:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:31:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100666  77 58564 27117299 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:31:57 [DEBUG   ] Got command RPT from MCS: ref #100667
2019-03-22 07:31:57 [DEBUG   ] summary = ERROR
2019-03-22 07:31:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100667  13 58564 27117503 A  ERRORERROR'
2019-03-22 07:31:57 [DEBUG   ] Got command RPT from MCS: ref #100668
2019-03-22 07:31:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:31:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100668  77 58564 27117695 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:31:57 [DEBUG   ] Got command RPT from MCS: ref #100669
2019-03-22 07:31:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:31:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100669  12 58564 27117899 A  ERRORB’™š'
2019-03-22 07:32:02 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 07:32:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:32:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:32:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:32:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:32:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:32:16 [DEBUG   ] Finished updating board flags in 2.196 seconds
2019-03-22 07:32:22 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 07:32:41 [DEBUG   ] Got command RPT from MCS: ref #100670
2019-03-22 07:32:41 [DEBUG   ] summary = ERROR
2019-03-22 07:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100670  13 58564 27161011 A  ERRORERROR'
2019-03-22 07:32:41 [DEBUG   ] Got command RPT from MCS: ref #100671
2019-03-22 07:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100671  77 58564 27161011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:32:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 07:33:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 07:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:33:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:33:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:33:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:33:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:33:16 [DEBUG   ] Finished updating board flags in 1.918 seconds
2019-03-22 07:33:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 07:33:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 07:34:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 07:34:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:34:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:34:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:34:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:34:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:34:16 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-03-22 07:34:22 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 07:34:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 07:35:02 [DEBUG   ] Finished updating ant stats in 1.351 seconds
2019-03-22 07:35:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:35:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:35:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:35:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:35:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:35:16 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-03-22 07:35:22 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-03-22 07:35:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 07:36:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 07:36:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:36:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:36:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:36:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:36:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:36:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:36:16 [DEBUG   ] Finished updating board flags in 1.771 seconds
2019-03-22 07:36:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 07:36:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 07:36:57 [DEBUG   ] Got command RPT from MCS: ref #100701
2019-03-22 07:36:57 [DEBUG   ] summary = ERROR
2019-03-22 07:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100701  13 58564 27417179 A  ERRORERROR'
2019-03-22 07:36:57 [DEBUG   ] Got command RPT from MCS: ref #100702
2019-03-22 07:36:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100702  77 58564 27417383 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:36:57 [DEBUG   ] Got command RPT from MCS: ref #100703
2019-03-22 07:36:57 [DEBUG   ] summary = ERROR
2019-03-22 07:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100703  13 58564 27417587 A  ERRORERROR'
2019-03-22 07:36:57 [DEBUG   ] Got command RPT from MCS: ref #100705
2019-03-22 07:36:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100705  77 58564 27417779 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:36:57 [DEBUG   ] Got command RPT from MCS: ref #100707
2019-03-22 07:36:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100707  12 58564 27417983 A  ERRORB’™š'
2019-03-22 07:37:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 07:37:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:37:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:37:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:37:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:37:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:37:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:37:16 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-03-22 07:37:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 07:37:41 [DEBUG   ] Got command RPT from MCS: ref #100711
2019-03-22 07:37:41 [DEBUG   ] summary = ERROR
2019-03-22 07:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100711  13 58564 27461019 A  ERRORERROR'
2019-03-22 07:37:41 [DEBUG   ] Got command RPT from MCS: ref #100712
2019-03-22 07:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100712  77 58564 27461019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:37:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 07:38:03 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 07:38:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:38:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:38:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:38:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:38:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:38:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:38:16 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-03-22 07:38:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 07:38:43 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 07:39:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 07:39:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:39:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:39:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:39:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:39:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:39:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:39:16 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-03-22 07:39:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 07:39:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 07:40:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 07:40:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:40:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:40:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:40:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:40:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:40:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:40:16 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-03-22 07:40:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 07:40:43 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-03-22 07:41:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:41:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:41:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:41:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:41:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:41:16 [WARNING ] (13, 1, 'bot')
2019-03-22 07:41:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:41:16 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-03-22 07:41:23 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-03-22 07:41:44 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 07:41:57 [DEBUG   ] Got command RPT from MCS: ref #100734
2019-03-22 07:41:57 [DEBUG   ] summary = ERROR
2019-03-22 07:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100734  13 58564 27717267 A  ERRORERROR'
2019-03-22 07:41:57 [DEBUG   ] Got command RPT from MCS: ref #100735
2019-03-22 07:41:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100735  77 58564 27717471 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:41:57 [DEBUG   ] Got command RPT from MCS: ref #100736
2019-03-22 07:41:57 [DEBUG   ] summary = ERROR
2019-03-22 07:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100736  13 58564 27717663 A  ERRORERROR'
2019-03-22 07:41:57 [DEBUG   ] Got command RPT from MCS: ref #100737
2019-03-22 07:41:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100737  77 58564 27717867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:41:58 [DEBUG   ] Got command RPT from MCS: ref #100738
2019-03-22 07:41:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100738  12 58564 27718071 A  ERRORB’™š'
2019-03-22 07:42:04 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 07:42:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:42:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:42:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:42:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:42:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:42:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:42:17 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-03-22 07:42:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 07:42:41 [DEBUG   ] Got command RPT from MCS: ref #100745
2019-03-22 07:42:41 [DEBUG   ] summary = ERROR
2019-03-22 07:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100745  13 58564 27761015 A  ERRORERROR'
2019-03-22 07:42:41 [DEBUG   ] Got command RPT from MCS: ref #100746
2019-03-22 07:42:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100746  77 58564 27761015 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:42:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 07:43:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 07:43:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:43:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:43:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:43:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:43:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:43:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:43:17 [DEBUG   ] Finished updating board flags in 2.191 seconds
2019-03-22 07:43:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 07:43:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 07:44:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 07:44:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:44:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:44:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:44:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:44:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:44:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:44:17 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-03-22 07:44:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 07:44:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 07:45:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 07:45:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:45:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:45:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:45:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:45:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:45:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:45:17 [DEBUG   ] Finished updating board flags in 2.038 seconds
2019-03-22 07:45:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 07:45:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 07:46:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 07:46:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:46:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:46:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:46:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:46:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:46:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:46:17 [DEBUG   ] Finished updating board flags in 1.954 seconds
2019-03-22 07:46:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:46:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 07:46:57 [DEBUG   ] Got command RPT from MCS: ref #100770
2019-03-22 07:46:57 [DEBUG   ] summary = ERROR
2019-03-22 07:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100770  13 58564 28017351 A  ERRORERROR'
2019-03-22 07:46:57 [DEBUG   ] Got command RPT from MCS: ref #100771
2019-03-22 07:46:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100771  77 58564 28017555 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:46:57 [DEBUG   ] Got command RPT from MCS: ref #100772
2019-03-22 07:46:57 [DEBUG   ] summary = ERROR
2019-03-22 07:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100772  13 58564 28017747 A  ERRORERROR'
2019-03-22 07:46:57 [DEBUG   ] Got command RPT from MCS: ref #100774
2019-03-22 07:46:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100774  77 58564 28017951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:46:58 [DEBUG   ] Got command RPT from MCS: ref #100776
2019-03-22 07:46:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100776  12 58564 28018155 A  ERRORB‘™š'
2019-03-22 07:47:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 07:47:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:47:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:47:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:47:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:47:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:47:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:47:17 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-03-22 07:47:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 07:47:41 [DEBUG   ] Got command RPT from MCS: ref #100780
2019-03-22 07:47:41 [DEBUG   ] summary = ERROR
2019-03-22 07:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100780  13 58564 28061019 A  ERRORERROR'
2019-03-22 07:47:41 [DEBUG   ] Got command RPT from MCS: ref #100781
2019-03-22 07:47:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100781  77 58564 28061019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:47:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 07:48:05 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 07:48:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:48:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:48:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:48:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:48:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:48:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:48:17 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-03-22 07:48:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 07:48:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 07:49:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 07:49:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:49:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:49:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:49:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:49:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:49:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:49:17 [DEBUG   ] Finished updating board flags in 1.777 seconds
2019-03-22 07:49:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 07:49:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 07:50:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 07:50:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:50:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:50:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:50:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:50:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:50:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:50:17 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-03-22 07:50:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 07:50:45 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 07:51:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:51:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:51:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:51:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:51:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:51:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:51:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:51:17 [DEBUG   ] Finished updating board flags in 1.573 seconds
2019-03-22 07:51:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 07:51:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 07:51:57 [DEBUG   ] Got command RPT from MCS: ref #100809
2019-03-22 07:51:57 [DEBUG   ] summary = ERROR
2019-03-22 07:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100809  13 58564 28317431 A  ERRORERROR'
2019-03-22 07:51:57 [DEBUG   ] Got command RPT from MCS: ref #100810
2019-03-22 07:51:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100810  77 58564 28317635 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:51:57 [DEBUG   ] Got command RPT from MCS: ref #100811
2019-03-22 07:51:57 [DEBUG   ] summary = ERROR
2019-03-22 07:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100811  13 58564 28317839 A  ERRORERROR'
2019-03-22 07:51:58 [DEBUG   ] Got command RPT from MCS: ref #100812
2019-03-22 07:51:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100812  77 58564 28318043 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:51:58 [DEBUG   ] Got command RPT from MCS: ref #100813
2019-03-22 07:51:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100813  12 58564 28318235 A  ERRORB”™š'
2019-03-22 07:52:05 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 07:52:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 07:52:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:52:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:52:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:52:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:52:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:52:17 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-03-22 07:52:25 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-03-22 07:52:41 [DEBUG   ] Got command RPT from MCS: ref #100814
2019-03-22 07:52:41 [DEBUG   ] summary = ERROR
2019-03-22 07:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100814  13 58564 28361015 A  ERRORERROR'
2019-03-22 07:52:41 [DEBUG   ] Got command RPT from MCS: ref #100815
2019-03-22 07:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100815  77 58564 28361015 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:52:46 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 07:53:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 07:53:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:53:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:53:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:53:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:53:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:53:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:53:17 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-03-22 07:53:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 07:53:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 07:54:06 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 07:54:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:54:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:54:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:54:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:54:17 [WARNING ] (13, 1, 'bot')
2019-03-22 07:54:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:54:17 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-03-22 07:54:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 07:54:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 07:55:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 07:55:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 07:55:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:55:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:55:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:55:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:55:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:55:18 [DEBUG   ] Finished updating board flags in 2.031 seconds
2019-03-22 07:55:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 07:55:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 07:56:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 07:56:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:56:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:56:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:56:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:56:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:56:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:56:18 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-03-22 07:56:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 07:56:46 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 07:56:57 [DEBUG   ] Got command RPT from MCS: ref #100839
2019-03-22 07:56:57 [DEBUG   ] summary = ERROR
2019-03-22 07:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100839  13 58564 28617515 A  ERRORERROR'
2019-03-22 07:56:57 [DEBUG   ] Got command RPT from MCS: ref #100840
2019-03-22 07:56:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100840  77 58564 28617719 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:56:57 [DEBUG   ] Got command RPT from MCS: ref #100841
2019-03-22 07:56:57 [DEBUG   ] summary = ERROR
2019-03-22 07:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100841  13 58564 28617923 A  ERRORERROR'
2019-03-22 07:56:58 [DEBUG   ] Got command RPT from MCS: ref #100843
2019-03-22 07:56:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100843  77 58564 28618127 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:56:58 [DEBUG   ] Got command RPT from MCS: ref #100844
2019-03-22 07:56:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 07:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100844  12 58564 28618319 A  ERRORB”™š'
2019-03-22 07:57:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 07:57:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:57:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:57:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:57:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:57:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:57:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:57:18 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-03-22 07:57:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 07:57:41 [DEBUG   ] Got command RPT from MCS: ref #100855
2019-03-22 07:57:41 [DEBUG   ] summary = ERROR
2019-03-22 07:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100855  13 58564 28661015 A  ERRORERROR'
2019-03-22 07:57:41 [DEBUG   ] Got command RPT from MCS: ref #100856
2019-03-22 07:57:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 07:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100856  77 58564 28661015 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 07:57:47 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 07:58:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 07:58:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:58:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:58:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:58:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:58:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:58:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:58:18 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-03-22 07:58:27 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 07:58:47 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 07:59:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 07:59:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 07:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 07:59:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:59:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:59:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:59:18 [WARNING ] (13, 1, 'bot')
2019-03-22 07:59:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 07:59:18 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-03-22 07:59:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 07:59:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 08:00:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 08:00:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:00:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:00:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:00:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:00:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:00:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:00:18 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-03-22 08:00:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 08:00:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 08:01:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 08:01:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:01:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:01:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:01:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:01:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:01:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:01:18 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-03-22 08:01:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 08:01:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 08:01:57 [DEBUG   ] Got command RPT from MCS: ref #100878
2019-03-22 08:01:57 [DEBUG   ] summary = ERROR
2019-03-22 08:01:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100878  13 58564 28917664 A  ERRORERROR'
2019-03-22 08:01:57 [DEBUG   ] Got command RPT from MCS: ref #100879
2019-03-22 08:01:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:01:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100879  77 58564 28917807 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:01:58 [DEBUG   ] Got command RPT from MCS: ref #100880
2019-03-22 08:01:58 [DEBUG   ] summary = ERROR
2019-03-22 08:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100880  13 58564 28918011 A  ERRORERROR'
2019-03-22 08:01:58 [DEBUG   ] Got command RPT from MCS: ref #100881
2019-03-22 08:01:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100881  77 58564 28918203 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:01:58 [DEBUG   ] Got command RPT from MCS: ref #100882
2019-03-22 08:01:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100882  12 58564 28918407 A  ERRORB“™š'
2019-03-22 08:02:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 08:02:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:02:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:02:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:02:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:02:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:02:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:02:18 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-03-22 08:02:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-03-22 08:02:41 [DEBUG   ] Got command RPT from MCS: ref #100883
2019-03-22 08:02:41 [DEBUG   ] summary = ERROR
2019-03-22 08:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100883  13 58564 28961015 A  ERRORERROR'
2019-03-22 08:02:41 [DEBUG   ] Got command RPT from MCS: ref #100884
2019-03-22 08:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100884  77 58564 28961015 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:02:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 08:03:08 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 08:03:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 08:03:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:03:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:03:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:03:18 [WARNING ] (13, 1, 'bot')
2019-03-22 08:03:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:03:18 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-03-22 08:03:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 08:03:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-03-22 08:04:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 08:04:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:04:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:04:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:04:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:04:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:04:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:04:19 [DEBUG   ] Finished updating board flags in 2.048 seconds
2019-03-22 08:04:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 08:04:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 08:05:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 08:05:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:05:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:05:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:05:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:05:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:05:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:05:19 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-03-22 08:05:28 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-03-22 08:05:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:06:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 08:06:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:06:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:06:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:06:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:06:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:06:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:06:19 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-03-22 08:06:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 08:06:48 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 08:06:57 [DEBUG   ] Got command RPT from MCS: ref #100914
2019-03-22 08:06:57 [DEBUG   ] summary = ERROR
2019-03-22 08:06:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100914  13 58564 29217691 A  ERRORERROR'
2019-03-22 08:06:57 [DEBUG   ] Got command RPT from MCS: ref #100915
2019-03-22 08:06:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:06:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100915  77 58564 29217895 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:06:58 [DEBUG   ] Got command RPT from MCS: ref #100916
2019-03-22 08:06:58 [DEBUG   ] summary = ERROR
2019-03-22 08:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100916  13 58564 29218099 A  ERRORERROR'
2019-03-22 08:06:58 [DEBUG   ] Got command RPT from MCS: ref #100918
2019-03-22 08:06:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100918  77 58564 29218291 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:06:58 [DEBUG   ] Got command RPT from MCS: ref #100920
2019-03-22 08:06:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100920  12 58564 29218495 A  ERRORB“™š'
2019-03-22 08:07:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 08:07:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:07:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:07:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:07:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:07:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:07:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:07:19 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-03-22 08:07:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 08:07:41 [DEBUG   ] Got command RPT from MCS: ref #100924
2019-03-22 08:07:41 [DEBUG   ] summary = ERROR
2019-03-22 08:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100924  13 58564 29261019 A  ERRORERROR'
2019-03-22 08:07:41 [DEBUG   ] Got command RPT from MCS: ref #100925
2019-03-22 08:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100925  77 58564 29261019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:07:49 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 08:08:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 08:08:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:08:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:08:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:08:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:08:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:08:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:08:19 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-03-22 08:08:29 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 08:08:48 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2019-03-22 08:09:09 [DEBUG   ] Finished updating ant stats in 1.406 seconds
2019-03-22 08:09:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:09:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:09:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:09:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:09:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:09:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:09:19 [DEBUG   ] Finished updating board flags in 1.761 seconds
2019-03-22 08:09:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 08:09:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 08:10:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 08:10:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:10:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:10:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:10:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:10:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:10:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:10:19 [DEBUG   ] Finished updating board flags in 1.686 seconds
2019-03-22 08:10:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 08:10:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 08:11:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 08:11:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:11:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:11:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:11:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:11:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:11:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:11:19 [DEBUG   ] Finished updating board flags in 1.524 seconds
2019-03-22 08:11:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 08:11:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 08:11:57 [DEBUG   ] Got command RPT from MCS: ref #100947
2019-03-22 08:11:57 [DEBUG   ] summary = ERROR
2019-03-22 08:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100947  13 58564 29517779 A  ERRORERROR'
2019-03-22 08:11:57 [DEBUG   ] Got command RPT from MCS: ref #100948
2019-03-22 08:11:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100948  77 58564 29517983 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:11:58 [DEBUG   ] Got command RPT from MCS: ref #100949
2019-03-22 08:11:58 [DEBUG   ] summary = ERROR
2019-03-22 08:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100949  13 58564 29518187 A  ERRORERROR'
2019-03-22 08:11:58 [DEBUG   ] Got command RPT from MCS: ref #100950
2019-03-22 08:11:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100950  77 58564 29518379 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:11:58 [DEBUG   ] Got command RPT from MCS: ref #100951
2019-03-22 08:11:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100951  12 58564 29518583 A  ERRORB’™š'
2019-03-22 08:12:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 08:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 08:12:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:12:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:12:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:12:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:12:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:12:19 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-03-22 08:12:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 08:12:41 [DEBUG   ] Got command RPT from MCS: ref #100958
2019-03-22 08:12:41 [DEBUG   ] summary = ERROR
2019-03-22 08:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100958  13 58564 29561023 A  ERRORERROR'
2019-03-22 08:12:41 [DEBUG   ] Got command RPT from MCS: ref #100959
2019-03-22 08:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100959  77 58564 29561023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:12:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 08:13:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 08:13:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:13:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:13:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:13:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:13:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:13:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:13:19 [DEBUG   ] Finished updating board flags in 1.452 seconds
2019-03-22 08:13:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:13:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 08:14:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 08:14:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:14:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:14:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:14:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:14:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:14:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:14:19 [DEBUG   ] Finished updating board flags in 1.444 seconds
2019-03-22 08:14:29 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 08:14:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 08:15:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 08:15:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:15:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:15:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:15:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:15:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:15:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:15:19 [DEBUG   ] Finished updating board flags in 1.447 seconds
2019-03-22 08:15:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 08:15:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 08:16:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 08:16:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:16:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:16:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:16:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:16:19 [WARNING ] (13, 1, 'bot')
2019-03-22 08:16:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:16:19 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-03-22 08:16:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 08:16:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 08:16:57 [DEBUG   ] Got command RPT from MCS: ref #100989
2019-03-22 08:16:57 [DEBUG   ] summary = ERROR
2019-03-22 08:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100989  13 58564 29817859 A  ERRORERROR'
2019-03-22 08:16:58 [DEBUG   ] Got command RPT from MCS: ref #100990
2019-03-22 08:16:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100990  77 58564 29818063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:16:58 [DEBUG   ] Got command RPT from MCS: ref #100991
2019-03-22 08:16:58 [DEBUG   ] summary = ERROR
2019-03-22 08:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100991  13 58564 29818267 A  ERRORERROR'
2019-03-22 08:16:58 [DEBUG   ] Got command RPT from MCS: ref #100993
2019-03-22 08:16:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100993  77 58564 29818471 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:16:58 [DEBUG   ] Got command RPT from MCS: ref #100995
2019-03-22 08:16:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   100995  12 58564 29818663 A  ERRORB’™š'
2019-03-22 08:17:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 08:17:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:17:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:17:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:17:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:17:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:17:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:17:20 [DEBUG   ] Finished updating board flags in 2.177 seconds
2019-03-22 08:17:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 08:17:41 [DEBUG   ] Got command RPT from MCS: ref #101004
2019-03-22 08:17:41 [DEBUG   ] summary = ERROR
2019-03-22 08:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101004  13 58564 29861023 A  ERRORERROR'
2019-03-22 08:17:41 [DEBUG   ] Got command RPT from MCS: ref #101005
2019-03-22 08:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101005  77 58564 29861023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:17:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 08:18:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 08:18:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:18:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:18:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:18:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:18:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:18:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:18:20 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-03-22 08:18:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 08:18:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 08:19:10 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 08:19:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:19:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:19:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:19:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:19:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:19:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:19:20 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-03-22 08:19:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 08:19:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 08:20:10 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 08:20:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:20:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:20:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:20:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:20:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:20:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:20:20 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-03-22 08:20:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-03-22 08:20:51 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-03-22 08:21:11 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-03-22 08:21:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:21:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:21:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:21:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:21:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:21:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:21:20 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-03-22 08:21:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 08:21:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 08:21:57 [DEBUG   ] Got command RPT from MCS: ref #101033
2019-03-22 08:21:57 [DEBUG   ] summary = ERROR
2019-03-22 08:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101033  13 58564 30117951 A  ERRORERROR'
2019-03-22 08:21:58 [DEBUG   ] Got command RPT from MCS: ref #101034
2019-03-22 08:21:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:21:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101034  77 58564 30118155 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:21:58 [DEBUG   ] Got command RPT from MCS: ref #101035
2019-03-22 08:21:58 [DEBUG   ] summary = ERROR
2019-03-22 08:21:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101035  13 58564 30118359 A  ERRORERROR'
2019-03-22 08:21:58 [DEBUG   ] Got command RPT from MCS: ref #101036
2019-03-22 08:21:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:21:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101036  77 58564 30118551 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:21:58 [DEBUG   ] Got command RPT from MCS: ref #101037
2019-03-22 08:21:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:21:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101037  12 58564 30118755 A  ERRORB‘™š'
2019-03-22 08:22:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 08:22:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 08:22:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:22:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:22:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:22:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:22:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:22:20 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-03-22 08:22:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 08:22:41 [DEBUG   ] Got command RPT from MCS: ref #101038
2019-03-22 08:22:41 [DEBUG   ] summary = ERROR
2019-03-22 08:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101038  13 58564 30161027 A  ERRORERROR'
2019-03-22 08:22:41 [DEBUG   ] Got command RPT from MCS: ref #101039
2019-03-22 08:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101039  77 58564 30161027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:22:51 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-03-22 08:23:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 08:23:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:23:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:23:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:23:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:23:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:23:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:23:20 [DEBUG   ] Finished updating board flags in 1.569 seconds
2019-03-22 08:23:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 08:23:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 08:24:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 08:24:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:24:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:24:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:24:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:24:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:24:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:24:20 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-03-22 08:24:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:24:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 08:25:12 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 08:25:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:25:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:25:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:25:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:25:20 [WARNING ] (13, 1, 'bot')
2019-03-22 08:25:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:25:20 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-03-22 08:25:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 08:25:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 08:26:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 08:26:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:26:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:26:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:26:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:26:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:26:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:26:21 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-03-22 08:26:32 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-03-22 08:26:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 08:26:58 [DEBUG   ] Got command RPT from MCS: ref #101063
2019-03-22 08:26:58 [DEBUG   ] summary = ERROR
2019-03-22 08:26:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101063  13 58564 30418039 A  ERRORERROR'
2019-03-22 08:26:58 [DEBUG   ] Got command RPT from MCS: ref #101064
2019-03-22 08:26:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:26:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101064  77 58564 30418243 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:26:58 [DEBUG   ] Got command RPT from MCS: ref #101065
2019-03-22 08:26:58 [DEBUG   ] summary = ERROR
2019-03-22 08:26:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101065  13 58564 30418435 A  ERRORERROR'
2019-03-22 08:26:58 [DEBUG   ] Got command RPT from MCS: ref #101067
2019-03-22 08:26:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:26:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101067  77 58564 30418639 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:26:58 [DEBUG   ] Got command RPT from MCS: ref #101068
2019-03-22 08:26:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:26:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101068  12 58564 30418843 A  ERRORB”™š'
2019-03-22 08:27:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 08:27:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:27:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:27:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:27:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:27:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:27:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:27:21 [DEBUG   ] Finished updating board flags in 2.196 seconds
2019-03-22 08:27:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 08:27:41 [DEBUG   ] Got command RPT from MCS: ref #101079
2019-03-22 08:27:41 [DEBUG   ] summary = ERROR
2019-03-22 08:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101079  13 58564 30461027 A  ERRORERROR'
2019-03-22 08:27:41 [DEBUG   ] Got command RPT from MCS: ref #101080
2019-03-22 08:27:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101080  77 58564 30461027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:27:52 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-03-22 08:28:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 08:28:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:28:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:28:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:28:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:28:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:28:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:28:21 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-03-22 08:28:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 08:28:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:29:12 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 08:29:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:29:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:29:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:29:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:29:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:29:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:29:21 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-03-22 08:29:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 08:29:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 08:30:13 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-03-22 08:30:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:30:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:30:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:30:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:30:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:30:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:30:21 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-03-22 08:30:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 08:30:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 08:31:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 08:31:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:31:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:31:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:31:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:31:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:31:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:31:21 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-03-22 08:31:33 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 08:31:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 08:31:58 [DEBUG   ] Got command RPT from MCS: ref #101102
2019-03-22 08:31:58 [DEBUG   ] summary = ERROR
2019-03-22 08:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101102  13 58564 30718127 A  ERRORERROR'
2019-03-22 08:31:58 [DEBUG   ] Got command RPT from MCS: ref #101103
2019-03-22 08:31:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101103  77 58564 30718319 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:31:58 [DEBUG   ] Got command RPT from MCS: ref #101104
2019-03-22 08:31:58 [DEBUG   ] summary = ERROR
2019-03-22 08:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101104  13 58564 30718523 A  ERRORERROR'
2019-03-22 08:31:58 [DEBUG   ] Got command RPT from MCS: ref #101105
2019-03-22 08:31:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101105  77 58564 30718727 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:31:58 [DEBUG   ] Got command RPT from MCS: ref #101106
2019-03-22 08:31:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:31:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101106  12 58564 30718931 A  ERRORB”™š'
2019-03-22 08:32:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 08:32:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:32:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:32:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:32:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:32:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:32:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:32:21 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-03-22 08:32:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 08:32:41 [DEBUG   ] Got command RPT from MCS: ref #101107
2019-03-22 08:32:41 [DEBUG   ] summary = ERROR
2019-03-22 08:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101107  13 58564 30761027 A  ERRORERROR'
2019-03-22 08:32:41 [DEBUG   ] Got command RPT from MCS: ref #101108
2019-03-22 08:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101108  77 58564 30761027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:32:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 08:33:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:33:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 08:33:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:33:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:33:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:33:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:33:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:33:21 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-03-22 08:33:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:33:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:34:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 08:34:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 08:34:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:34:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:34:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:34:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:34:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:34:21 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-03-22 08:34:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 08:34:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 08:35:14 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2019-03-22 08:35:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:35:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:35:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:35:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:35:21 [WARNING ] (13, 1, 'bot')
2019-03-22 08:35:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:35:21 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-03-22 08:35:34 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 08:35:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 08:36:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 08:36:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:36:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:36:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:36:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:36:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:36:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:36:22 [DEBUG   ] Finished updating board flags in 2.055 seconds
2019-03-22 08:36:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 08:36:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 08:36:58 [DEBUG   ] Got command RPT from MCS: ref #101138
2019-03-22 08:36:58 [DEBUG   ] summary = ERROR
2019-03-22 08:36:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101138  13 58564 31018211 A  ERRORERROR'
2019-03-22 08:36:58 [DEBUG   ] Got command RPT from MCS: ref #101139
2019-03-22 08:36:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:36:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101139  77 58564 31018403 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:36:58 [DEBUG   ] Got command RPT from MCS: ref #101140
2019-03-22 08:36:58 [DEBUG   ] summary = ERROR
2019-03-22 08:36:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101140  13 58564 31018607 A  ERRORERROR'
2019-03-22 08:36:58 [DEBUG   ] Got command RPT from MCS: ref #101142
2019-03-22 08:36:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:36:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101142  77 58564 31018811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:36:59 [DEBUG   ] Got command RPT from MCS: ref #101144
2019-03-22 08:36:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:36:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101144  12 58564 31019015 A  ERRORB“™š'
2019-03-22 08:37:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 08:37:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:37:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 08:37:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:37:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:37:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:37:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:37:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:37:22 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-03-22 08:37:34 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 08:37:41 [DEBUG   ] Got command RPT from MCS: ref #101148
2019-03-22 08:37:41 [DEBUG   ] summary = ERROR
2019-03-22 08:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101148  13 58564 31061027 A  ERRORERROR'
2019-03-22 08:37:41 [DEBUG   ] Got command RPT from MCS: ref #101149
2019-03-22 08:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101149  77 58564 31061027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:37:54 [DEBUG   ] Finished updating ant stats in 0.982 seconds
2019-03-22 08:38:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:38:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:38:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:38:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:38:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:38:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:38:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:38:22 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-03-22 08:38:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 08:38:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 08:39:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 08:39:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:39:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:39:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:39:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:39:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:39:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:39:22 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-03-22 08:39:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 08:39:55 [DEBUG   ] Finished updating ant stats in 1.373 seconds
2019-03-22 08:40:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 08:40:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:40:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:40:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:40:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:40:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:40:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:40:22 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-03-22 08:40:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 08:40:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 08:41:15 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-03-22 08:41:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:41:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 08:41:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:41:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:41:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:41:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:41:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:41:22 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-03-22 08:41:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 08:41:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-03-22 08:41:58 [DEBUG   ] Got command RPT from MCS: ref #101171
2019-03-22 08:41:58 [DEBUG   ] summary = ERROR
2019-03-22 08:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101171  13 58564 31318299 A  ERRORERROR'
2019-03-22 08:41:58 [DEBUG   ] Got command RPT from MCS: ref #101172
2019-03-22 08:41:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101172  77 58564 31318491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:41:58 [DEBUG   ] Got command RPT from MCS: ref #101173
2019-03-22 08:41:58 [DEBUG   ] summary = ERROR
2019-03-22 08:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101173  13 58564 31318695 A  ERRORERROR'
2019-03-22 08:41:58 [DEBUG   ] Got command RPT from MCS: ref #101174
2019-03-22 08:41:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101174  77 58564 31318899 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:41:59 [DEBUG   ] Got command RPT from MCS: ref #101175
2019-03-22 08:41:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101175  12 58564 31319103 A  ERRORB’™š'
2019-03-22 08:42:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 08:42:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:42:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:42:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:42:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:42:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:42:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:42:22 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-03-22 08:42:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 08:42:41 [DEBUG   ] Got command RPT from MCS: ref #101182
2019-03-22 08:42:41 [DEBUG   ] summary = ERROR
2019-03-22 08:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101182  13 58564 31361027 A  ERRORERROR'
2019-03-22 08:42:41 [DEBUG   ] Got command RPT from MCS: ref #101183
2019-03-22 08:42:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101183  77 58564 31361027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:42:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:43:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 08:43:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:43:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 08:43:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:43:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:43:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:43:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:43:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:43:22 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-03-22 08:43:36 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 08:43:56 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 08:44:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 08:44:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:44:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:44:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:44:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:44:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:44:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:44:23 [DEBUG   ] Finished updating board flags in 2.201 seconds
2019-03-22 08:44:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 08:44:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-22 08:45:16 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 08:45:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:45:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:45:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:45:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:45:22 [WARNING ] (13, 1, 'bot')
2019-03-22 08:45:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:45:22 [DEBUG   ] Finished updating board flags in 1.328 seconds
2019-03-22 08:45:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 08:45:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 08:46:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 08:46:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:46:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2019-03-22 08:46:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:46:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:46:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:46:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:46:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:46:23 [DEBUG   ] Finished updating board flags in 2.084 seconds
2019-03-22 08:46:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:46:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:46:58 [DEBUG   ] Got command RPT from MCS: ref #101207
2019-03-22 08:46:58 [DEBUG   ] summary = ERROR
2019-03-22 08:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101207  13 58564 31618383 A  ERRORERROR'
2019-03-22 08:46:58 [DEBUG   ] Got command RPT from MCS: ref #101208
2019-03-22 08:46:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101208  77 58564 31618587 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:46:58 [DEBUG   ] Got command RPT from MCS: ref #101209
2019-03-22 08:46:58 [DEBUG   ] summary = ERROR
2019-03-22 08:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101209  13 58564 31618779 A  ERRORERROR'
2019-03-22 08:46:58 [DEBUG   ] Got command RPT from MCS: ref #101211
2019-03-22 08:46:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101211  77 58564 31618983 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:46:59 [DEBUG   ] Got command RPT from MCS: ref #101212
2019-03-22 08:46:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101212  12 58564 31619187 A  ERRORB’™š'
2019-03-22 08:47:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 08:47:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:47:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:47:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:47:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:47:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:47:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:47:23 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-03-22 08:47:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 08:47:41 [DEBUG   ] Got command RPT from MCS: ref #101217
2019-03-22 08:47:41 [DEBUG   ] summary = ERROR
2019-03-22 08:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101217  13 58564 31661027 A  ERRORERROR'
2019-03-22 08:47:41 [DEBUG   ] Got command RPT from MCS: ref #101218
2019-03-22 08:47:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101218  77 58564 31661027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:47:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 08:48:17 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 08:48:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:48:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:48:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:48:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:48:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:48:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:48:23 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-03-22 08:48:37 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-03-22 08:48:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 08:49:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 08:49:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:49:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:49:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:49:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:49:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:49:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:49:23 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-03-22 08:49:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 08:49:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 08:50:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 08:50:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:50:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:50:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:50:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:50:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:50:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:50:23 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-03-22 08:50:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 08:50:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 08:51:17 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-03-22 08:51:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:51:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:51:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:51:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:51:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:51:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:51:23 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-03-22 08:51:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:51:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 08:51:58 [DEBUG   ] Got command RPT from MCS: ref #101246
2019-03-22 08:51:58 [DEBUG   ] summary = ERROR
2019-03-22 08:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101246  13 58564 31918463 A  ERRORERROR'
2019-03-22 08:51:58 [DEBUG   ] Got command RPT from MCS: ref #101247
2019-03-22 08:51:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101247  77 58564 31918667 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:51:58 [DEBUG   ] Got command RPT from MCS: ref #101248
2019-03-22 08:51:58 [DEBUG   ] summary = ERROR
2019-03-22 08:51:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101248  13 58564 31918871 A  ERRORERROR'
2019-03-22 08:51:59 [DEBUG   ] Got command RPT from MCS: ref #101249
2019-03-22 08:51:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101249  77 58564 31919075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:51:59 [DEBUG   ] Got command RPT from MCS: ref #101250
2019-03-22 08:51:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101250  12 58564 31919267 A  ERRORB”™š'
2019-03-22 08:52:17 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 08:52:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:52:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:52:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:52:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:52:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:52:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:52:23 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-03-22 08:52:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 08:52:41 [DEBUG   ] Got command RPT from MCS: ref #101251
2019-03-22 08:52:41 [DEBUG   ] summary = ERROR
2019-03-22 08:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101251  13 58564 31961035 A  ERRORERROR'
2019-03-22 08:52:41 [DEBUG   ] Got command RPT from MCS: ref #101252
2019-03-22 08:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101252  77 58564 31961035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:52:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 08:53:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 08:53:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:53:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:53:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:53:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:53:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:53:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:53:23 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-03-22 08:53:38 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 08:53:57 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-03-22 08:54:18 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2019-03-22 08:54:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:54:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:54:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:54:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:54:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:54:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:54:23 [DEBUG   ] Finished updating board flags in 1.464 seconds
2019-03-22 08:54:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 08:54:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 08:55:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 08:55:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:55:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:55:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:55:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:55:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:55:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:55:23 [DEBUG   ] Finished updating board flags in 1.467 seconds
2019-03-22 08:55:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 08:55:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 08:56:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 08:56:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:56:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:56:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:56:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:56:23 [WARNING ] (13, 1, 'bot')
2019-03-22 08:56:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:56:23 [DEBUG   ] Finished updating board flags in 1.467 seconds
2019-03-22 08:56:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 08:56:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 08:56:58 [DEBUG   ] Got command RPT from MCS: ref #101276
2019-03-22 08:56:58 [DEBUG   ] summary = ERROR
2019-03-22 08:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101276  13 58564 32218547 A  ERRORERROR'
2019-03-22 08:56:58 [DEBUG   ] Got command RPT from MCS: ref #101277
2019-03-22 08:56:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101277  77 58564 32218751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:56:58 [DEBUG   ] Got command RPT from MCS: ref #101278
2019-03-22 08:56:58 [DEBUG   ] summary = ERROR
2019-03-22 08:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101278  13 58564 32218955 A  ERRORERROR'
2019-03-22 08:56:59 [DEBUG   ] Got command RPT from MCS: ref #101280
2019-03-22 08:56:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101280  77 58564 32219159 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:56:59 [DEBUG   ] Got command RPT from MCS: ref #101281
2019-03-22 08:56:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 08:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101281  12 58564 32219351 A  ERRORB”™š'
2019-03-22 08:57:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 08:57:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:57:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:57:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:57:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:57:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:57:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:57:24 [DEBUG   ] Finished updating board flags in 2.212 seconds
2019-03-22 08:57:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 08:57:41 [DEBUG   ] Got command RPT from MCS: ref #101292
2019-03-22 08:57:41 [DEBUG   ] summary = ERROR
2019-03-22 08:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101292  13 58564 32261039 A  ERRORERROR'
2019-03-22 08:57:41 [DEBUG   ] Got command RPT from MCS: ref #101293
2019-03-22 08:57:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 08:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101293  77 58564 32261039 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 08:57:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 08:58:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 08:58:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:58:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:58:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:58:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:58:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:58:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:58:24 [DEBUG   ] Finished updating board flags in 2.134 seconds
2019-03-22 08:58:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 08:58:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 08:59:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 08:59:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 08:59:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:59:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:59:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:59:24 [WARNING ] (13, 1, 'bot')
2019-03-22 08:59:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 08:59:24 [DEBUG   ] Finished updating board flags in 2.059 seconds
2019-03-22 08:59:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 08:59:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 09:00:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 09:00:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:00:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:00:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:00:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:00:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:00:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:00:24 [DEBUG   ] Finished updating board flags in 1.950 seconds
2019-03-22 09:00:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 09:00:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 09:01:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 09:01:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:01:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 09:01:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 09:01:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:01:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:01:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:01:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:01:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:01:24 [DEBUG   ] Finished updating board flags in 1.837 seconds
2019-03-22 09:01:39 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-03-22 09:01:58 [DEBUG   ] Got command RPT from MCS: ref #101315
2019-03-22 09:01:58 [DEBUG   ] summary = ERROR
2019-03-22 09:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101315  13 58564 32518631 A  ERRORERROR'
2019-03-22 09:01:58 [DEBUG   ] Got command RPT from MCS: ref #101316
2019-03-22 09:01:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101316  77 58564 32518835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:01:59 [DEBUG   ] Got command RPT from MCS: ref #101317
2019-03-22 09:01:59 [DEBUG   ] summary = ERROR
2019-03-22 09:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101317  13 58564 32519039 A  ERRORERROR'
2019-03-22 09:01:59 [DEBUG   ] Got command RPT from MCS: ref #101318
2019-03-22 09:01:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101318  77 58564 32519243 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:01:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 09:01:59 [DEBUG   ] Got command RPT from MCS: ref #101319
2019-03-22 09:01:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101319  12 58564 32519435 A  ERRORB“™š'
2019-03-22 09:02:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 09:02:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:02:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:02:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:02:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:02:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:02:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:02:24 [DEBUG   ] Finished updating board flags in 1.766 seconds
2019-03-22 09:02:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 09:02:41 [DEBUG   ] Got command RPT from MCS: ref #101320
2019-03-22 09:02:41 [DEBUG   ] summary = ERROR
2019-03-22 09:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101320  13 58564 32561035 A  ERRORERROR'
2019-03-22 09:02:41 [DEBUG   ] Got command RPT from MCS: ref #101321
2019-03-22 09:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101321  77 58564 32561035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:02:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 09:03:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 09:03:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 09:03:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:03:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:03:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:03:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:03:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:03:24 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-03-22 09:03:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 09:03:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 09:04:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 09:04:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 09:04:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:04:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:04:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:04:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:04:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:04:24 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-03-22 09:04:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 09:04:59 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 09:05:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 09:05:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:05:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:05:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:05:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:05:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:05:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:05:24 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-03-22 09:05:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 09:06:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 09:06:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 09:06:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:06:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:06:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:06:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:06:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:06:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:06:24 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-03-22 09:06:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-03-22 09:06:58 [DEBUG   ] Got command RPT from MCS: ref #101351
2019-03-22 09:06:58 [DEBUG   ] summary = ERROR
2019-03-22 09:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101351  13 58564 32818727 A  ERRORERROR'
2019-03-22 09:06:58 [DEBUG   ] Got command RPT from MCS: ref #101352
2019-03-22 09:06:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101352  77 58564 32818919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:06:59 [DEBUG   ] Got command RPT from MCS: ref #101353
2019-03-22 09:06:59 [DEBUG   ] summary = ERROR
2019-03-22 09:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101353  13 58564 32819124 A  ERRORERROR'
2019-03-22 09:06:59 [DEBUG   ] Got command RPT from MCS: ref #101355
2019-03-22 09:06:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101355  77 58564 32819327 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:06:59 [DEBUG   ] Got command RPT from MCS: ref #101356
2019-03-22 09:06:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101356  12 58564 32819531 A  ERRORB“™š'
2019-03-22 09:07:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 09:07:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 09:07:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:07:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:07:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:07:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:07:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:07:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:07:24 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-03-22 09:07:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 09:07:41 [DEBUG   ] Got command RPT from MCS: ref #101361
2019-03-22 09:07:41 [DEBUG   ] summary = ERROR
2019-03-22 09:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101361  13 58564 32861035 A  ERRORERROR'
2019-03-22 09:07:41 [DEBUG   ] Got command RPT from MCS: ref #101362
2019-03-22 09:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101362  77 58564 32861035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:08:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 09:08:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 09:08:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:08:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:08:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:08:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:08:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:08:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:08:24 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-03-22 09:08:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 09:09:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 09:09:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 09:09:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:09:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 09:09:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:09:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:09:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:09:24 [WARNING ] (13, 1, 'bot')
2019-03-22 09:09:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:09:24 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-03-22 09:09:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 09:10:00 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-03-22 09:10:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 09:10:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:10:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:10:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:10:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:10:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:10:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:10:25 [DEBUG   ] Finished updating board flags in 2.050 seconds
2019-03-22 09:10:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 09:11:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 09:11:20 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 09:11:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:11:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:11:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:11:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:11:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:11:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:11:25 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-03-22 09:11:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 09:11:58 [DEBUG   ] Got command RPT from MCS: ref #101384
2019-03-22 09:11:58 [DEBUG   ] summary = ERROR
2019-03-22 09:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101384  13 58564 33118807 A  ERRORERROR'
2019-03-22 09:11:59 [DEBUG   ] Got command RPT from MCS: ref #101385
2019-03-22 09:11:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101385  77 58564 33119018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:11:59 [DEBUG   ] Got command RPT from MCS: ref #101386
2019-03-22 09:11:59 [DEBUG   ] summary = ERROR
2019-03-22 09:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101386  13 58564 33119207 A  ERRORERROR'
2019-03-22 09:11:59 [DEBUG   ] Got command RPT from MCS: ref #101387
2019-03-22 09:11:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101387  77 58564 33119411 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:11:59 [DEBUG   ] Got command RPT from MCS: ref #101388
2019-03-22 09:11:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101388  12 58564 33119603 A  ERRORB’™š'
2019-03-22 09:12:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 09:12:21 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-03-22 09:12:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:12:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:12:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:12:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:12:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:12:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:12:25 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-03-22 09:12:41 [DEBUG   ] Got command RPT from MCS: ref #101395
2019-03-22 09:12:41 [DEBUG   ] summary = ERROR
2019-03-22 09:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101395  13 58564 33161039 A  ERRORERROR'
2019-03-22 09:12:41 [DEBUG   ] Got command RPT from MCS: ref #101396
2019-03-22 09:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101396  77 58564 33161039 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:12:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 09:13:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 09:13:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 09:13:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:13:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:13:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:13:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:13:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:13:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:13:25 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-03-22 09:13:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 09:14:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 09:14:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 09:14:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:14:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:14:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:14:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:14:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:14:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:14:25 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-03-22 09:14:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 09:15:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 09:15:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 09:15:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:15:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:15:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:15:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:15:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:15:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:15:25 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-03-22 09:15:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 09:16:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 09:16:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 09:16:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:16:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:16:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:16:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:16:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:16:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:16:25 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-03-22 09:16:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 09:16:58 [DEBUG   ] Got command RPT from MCS: ref #101420
2019-03-22 09:16:58 [DEBUG   ] summary = ERROR
2019-03-22 09:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101420  13 58564 33418887 A  ERRORERROR'
2019-03-22 09:16:59 [DEBUG   ] Got command RPT from MCS: ref #101421
2019-03-22 09:16:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101421  77 58564 33419091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:16:59 [DEBUG   ] Got command RPT from MCS: ref #101422
2019-03-22 09:16:59 [DEBUG   ] summary = ERROR
2019-03-22 09:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101422  13 58564 33419295 A  ERRORERROR'
2019-03-22 09:16:59 [DEBUG   ] Got command RPT from MCS: ref #101424
2019-03-22 09:16:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101424  77 58564 33419487 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:16:59 [DEBUG   ] Got command RPT from MCS: ref #101425
2019-03-22 09:16:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101425  12 58564 33419691 A  ERRORB’™š'
2019-03-22 09:17:01 [DEBUG   ] Finished updating ant stats in 0.871 seconds
2019-03-22 09:17:21 [DEBUG   ] Finished updating ant stats in 0.732 seconds
2019-03-22 09:17:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:17:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:17:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:17:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:17:25 [WARNING ] (13, 1, 'bot')
2019-03-22 09:17:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:17:25 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-03-22 09:17:41 [DEBUG   ] Got command RPT from MCS: ref #101430
2019-03-22 09:17:41 [DEBUG   ] summary = ERROR
2019-03-22 09:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101430  13 58564 33461039 A  ERRORERROR'
2019-03-22 09:17:41 [DEBUG   ] Got command RPT from MCS: ref #101431
2019-03-22 09:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101431  77 58564 33461039 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:17:41 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2019-03-22 09:18:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 09:18:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 09:18:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:18:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2019-03-22 09:18:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 09:18:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:18:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:18:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:18:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:18:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:18:26 [DEBUG   ] Finished updating board flags in 2.210 seconds
2019-03-22 09:18:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 09:19:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 09:19:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 09:19:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:19:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:19:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:19:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:19:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:19:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:19:26 [DEBUG   ] Finished updating board flags in 2.209 seconds
2019-03-22 09:19:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 09:20:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 09:20:22 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2019-03-22 09:20:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:20:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:20:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:20:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:20:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:20:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:20:26 [DEBUG   ] Finished updating board flags in 2.179 seconds
2019-03-22 09:20:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 09:21:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 09:21:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 09:21:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:21:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:21:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:21:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:21:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:21:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:21:26 [DEBUG   ] Finished updating board flags in 2.022 seconds
2019-03-22 09:21:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 09:21:58 [DEBUG   ] Got command RPT from MCS: ref #101459
2019-03-22 09:21:58 [DEBUG   ] summary = ERROR
2019-03-22 09:21:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101459  13 58564 33718975 A  ERRORERROR'
2019-03-22 09:21:59 [DEBUG   ] Got command RPT from MCS: ref #101460
2019-03-22 09:21:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101460  77 58564 33719179 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:21:59 [DEBUG   ] Got command RPT from MCS: ref #101461
2019-03-22 09:21:59 [DEBUG   ] summary = ERROR
2019-03-22 09:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101461  13 58564 33719371 A  ERRORERROR'
2019-03-22 09:21:59 [DEBUG   ] Got command RPT from MCS: ref #101462
2019-03-22 09:21:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101462  77 58564 33719575 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:21:59 [DEBUG   ] Got command RPT from MCS: ref #101463
2019-03-22 09:21:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101463  12 58564 33719779 A  ERRORB“™š'
2019-03-22 09:22:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 09:22:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 09:22:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:22:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:22:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:22:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:22:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:22:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:22:26 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-03-22 09:22:41 [DEBUG   ] Got command RPT from MCS: ref #101464
2019-03-22 09:22:41 [DEBUG   ] summary = ERROR
2019-03-22 09:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101464  13 58564 33761039 A  ERRORERROR'
2019-03-22 09:22:41 [DEBUG   ] Got command RPT from MCS: ref #101465
2019-03-22 09:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101465  77 58564 33761039 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:22:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-03-22 09:23:03 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 09:23:23 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-03-22 09:23:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:23:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:23:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:23:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:23:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:23:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:23:26 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-03-22 09:23:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 09:24:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 09:24:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 09:24:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:24:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:24:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:24:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:24:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:24:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:24:26 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-03-22 09:24:43 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-03-22 09:25:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 09:25:24 [DEBUG   ] Finished updating ant stats in 1.800 seconds
2019-03-22 09:25:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:25:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:25:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:25:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:25:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:25:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:25:26 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-03-22 09:25:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 09:26:03 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 09:26:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 09:26:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:26:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:26:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:26:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:26:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:26:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:26:26 [DEBUG   ] Finished updating board flags in 1.703 seconds
2019-03-22 09:26:43 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2019-03-22 09:26:59 [DEBUG   ] Got command RPT from MCS: ref #101489
2019-03-22 09:26:59 [DEBUG   ] summary = ERROR
2019-03-22 09:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101489  13 58564 34019067 A  ERRORERROR'
2019-03-22 09:26:59 [DEBUG   ] Got command RPT from MCS: ref #101490
2019-03-22 09:26:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101490  77 58564 34019259 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:26:59 [DEBUG   ] Got command RPT from MCS: ref #101491
2019-03-22 09:26:59 [DEBUG   ] summary = ERROR
2019-03-22 09:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101491  13 58564 34019463 A  ERRORERROR'
2019-03-22 09:26:59 [DEBUG   ] Got command RPT from MCS: ref #101493
2019-03-22 09:26:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101493  77 58564 34019667 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:26:59 [DEBUG   ] Got command RPT from MCS: ref #101494
2019-03-22 09:26:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101494  12 58564 34019859 A  ERRORB”™š'
2019-03-22 09:27:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 09:27:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 09:27:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:27:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:27:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:27:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:27:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:27:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:27:26 [DEBUG   ] Finished updating board flags in 1.486 seconds
2019-03-22 09:27:41 [DEBUG   ] Got command RPT from MCS: ref #101505
2019-03-22 09:27:41 [DEBUG   ] summary = ERROR
2019-03-22 09:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101505  13 58564 34061043 A  ERRORERROR'
2019-03-22 09:27:41 [DEBUG   ] Got command RPT from MCS: ref #101506
2019-03-22 09:27:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101506  77 58564 34061043 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:27:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 09:28:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 09:28:24 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-03-22 09:28:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:28:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:28:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:28:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:28:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:28:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:28:26 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-03-22 09:28:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 09:29:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 09:29:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 09:29:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:29:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:29:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:29:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:29:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:29:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:29:26 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-03-22 09:29:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 09:30:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 09:30:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 09:30:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:30:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:30:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:30:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:30:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:30:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:30:26 [DEBUG   ] Finished updating board flags in 1.437 seconds
2019-03-22 09:30:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 09:31:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 09:31:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 09:31:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:31:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:31:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:31:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:31:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:31:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:31:26 [DEBUG   ] Finished updating board flags in 1.443 seconds
2019-03-22 09:31:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 09:31:59 [DEBUG   ] Got command RPT from MCS: ref #101528
2019-03-22 09:31:59 [DEBUG   ] summary = ERROR
2019-03-22 09:31:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101528  13 58564 34319143 A  ERRORERROR'
2019-03-22 09:31:59 [DEBUG   ] Got command RPT from MCS: ref #101529
2019-03-22 09:31:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:31:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101529  77 58564 34319347 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:31:59 [DEBUG   ] Got command RPT from MCS: ref #101530
2019-03-22 09:31:59 [DEBUG   ] summary = ERROR
2019-03-22 09:31:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101530  13 58564 34319551 A  ERRORERROR'
2019-03-22 09:31:59 [DEBUG   ] Got command RPT from MCS: ref #101531
2019-03-22 09:31:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:31:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101531  77 58564 34319755 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:31:59 [DEBUG   ] Got command RPT from MCS: ref #101532
2019-03-22 09:31:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:31:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101532  12 58564 34319947 A  ERRORB”™š'
2019-03-22 09:32:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 09:32:24 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 09:32:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:32:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:32:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:32:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:32:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:32:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:32:26 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-03-22 09:32:41 [DEBUG   ] Got command RPT from MCS: ref #101533
2019-03-22 09:32:41 [DEBUG   ] summary = ERROR
2019-03-22 09:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101533  13 58564 34361039 A  ERRORERROR'
2019-03-22 09:32:41 [DEBUG   ] Got command RPT from MCS: ref #101534
2019-03-22 09:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101534  77 58564 34361039 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:32:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 09:33:05 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 09:33:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 09:33:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:33:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:33:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:33:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:33:26 [WARNING ] (13, 1, 'bot')
2019-03-22 09:33:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:33:26 [DEBUG   ] Finished updating board flags in 1.447 seconds
2019-03-22 09:33:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 09:34:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 09:34:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 09:34:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:34:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:34:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:34:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:34:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:34:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:34:27 [DEBUG   ] Finished updating board flags in 2.198 seconds
2019-03-22 09:34:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 09:35:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 09:35:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 09:35:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:35:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 09:35:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:35:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:35:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:35:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:35:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:35:27 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-03-22 09:35:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 09:36:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 09:36:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 09:36:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:36:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:36:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:36:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:36:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:36:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:36:27 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-03-22 09:36:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 09:36:59 [DEBUG   ] Got command RPT from MCS: ref #101564
2019-03-22 09:36:59 [DEBUG   ] summary = ERROR
2019-03-22 09:36:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101564  13 58564 34619231 A  ERRORERROR'
2019-03-22 09:36:59 [DEBUG   ] Got command RPT from MCS: ref #101565
2019-03-22 09:36:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:36:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101565  77 58564 34619435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:36:59 [DEBUG   ] Got command RPT from MCS: ref #101566
2019-03-22 09:36:59 [DEBUG   ] summary = ERROR
2019-03-22 09:36:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101566  13 58564 34619639 A  ERRORERROR'
2019-03-22 09:36:59 [DEBUG   ] Got command RPT from MCS: ref #101568
2019-03-22 09:36:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:36:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101568  77 58564 34619831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:37:00 [DEBUG   ] Got command RPT from MCS: ref #101570
2019-03-22 09:37:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101570  12 58564 34620035 A  ERRORB“™š'
2019-03-22 09:37:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 09:37:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 09:37:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:37:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:37:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:37:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:37:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:37:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:37:27 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-03-22 09:37:41 [DEBUG   ] Got command RPT from MCS: ref #101574
2019-03-22 09:37:41 [DEBUG   ] summary = ERROR
2019-03-22 09:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101574  13 58564 34661047 A  ERRORERROR'
2019-03-22 09:37:41 [DEBUG   ] Got command RPT from MCS: ref #101575
2019-03-22 09:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101575  77 58564 34661047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:37:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 09:38:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 09:38:26 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2019-03-22 09:38:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:38:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 09:38:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:38:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:38:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:38:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:38:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:38:27 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-03-22 09:38:46 [DEBUG   ] Finished updating ant stats in 1.152 seconds
2019-03-22 09:39:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 09:39:26 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2019-03-22 09:39:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:39:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 09:39:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:39:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:39:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:39:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:39:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:39:27 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-03-22 09:39:46 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2019-03-22 09:40:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 09:40:26 [DEBUG   ] Finished updating ant stats in 0.651 seconds
2019-03-22 09:40:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:40:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 09:40:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:40:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:40:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:40:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:40:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:40:27 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-03-22 09:40:46 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2019-03-22 09:41:07 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 09:41:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:41:27 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2019-03-22 09:41:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:41:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:41:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:41:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:41:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:41:27 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-03-22 09:41:47 [DEBUG   ] Finished updating ant stats in 1.161 seconds
2019-03-22 09:41:59 [DEBUG   ] Got command RPT from MCS: ref #101597
2019-03-22 09:41:59 [DEBUG   ] summary = ERROR
2019-03-22 09:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101597  13 58564 34919319 A  ERRORERROR'
2019-03-22 09:41:59 [DEBUG   ] Got command RPT from MCS: ref #101598
2019-03-22 09:41:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101598  77 58564 34919523 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:41:59 [DEBUG   ] Got command RPT from MCS: ref #101599
2019-03-22 09:41:59 [DEBUG   ] summary = ERROR
2019-03-22 09:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101599  13 58564 34919715 A  ERRORERROR'
2019-03-22 09:41:59 [DEBUG   ] Got command RPT from MCS: ref #101600
2019-03-22 09:41:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101600  77 58564 34919919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:42:00 [DEBUG   ] Got command RPT from MCS: ref #101601
2019-03-22 09:42:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:42:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101601  12 58564 34920123 A  ERRORB’™š'
2019-03-22 09:42:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 09:42:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:42:27 [DEBUG   ] Finished updating ant stats in 1.040 seconds
2019-03-22 09:42:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 09:42:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:42:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:42:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:42:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:42:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:42:27 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-03-22 09:42:41 [DEBUG   ] Got command RPT from MCS: ref #101608
2019-03-22 09:42:41 [DEBUG   ] summary = ERROR
2019-03-22 09:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101608  13 58564 34961047 A  ERRORERROR'
2019-03-22 09:42:41 [DEBUG   ] Got command RPT from MCS: ref #101609
2019-03-22 09:42:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101609  77 58564 34961047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:42:47 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2019-03-22 09:43:07 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-03-22 09:43:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:43:27 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2019-03-22 09:43:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:43:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:43:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:43:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:43:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:43:27 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-03-22 09:43:47 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2019-03-22 09:44:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 09:44:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:44:27 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2019-03-22 09:44:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:44:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:44:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:44:27 [WARNING ] (13, 1, 'bot')
2019-03-22 09:44:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:44:27 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-03-22 09:44:47 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2019-03-22 09:45:08 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 09:45:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:45:28 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2019-03-22 09:45:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:45:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:45:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:45:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:45:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:45:28 [DEBUG   ] Finished updating board flags in 2.225 seconds
2019-03-22 09:45:48 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2019-03-22 09:46:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 09:46:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:46:28 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2019-03-22 09:46:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 09:46:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:46:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:46:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:46:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:46:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:46:28 [DEBUG   ] Finished updating board flags in 2.190 seconds
2019-03-22 09:46:48 [DEBUG   ] Finished updating ant stats in 0.762 seconds
2019-03-22 09:46:59 [DEBUG   ] Got command RPT from MCS: ref #101633
2019-03-22 09:46:59 [DEBUG   ] summary = ERROR
2019-03-22 09:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101633  13 58564 35219403 A  ERRORERROR'
2019-03-22 09:46:59 [DEBUG   ] Got command RPT from MCS: ref #101634
2019-03-22 09:46:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101634  77 58564 35219607 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:46:59 [DEBUG   ] Got command RPT from MCS: ref #101635
2019-03-22 09:46:59 [DEBUG   ] summary = ERROR
2019-03-22 09:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101635  13 58564 35219811 A  ERRORERROR'
2019-03-22 09:47:00 [DEBUG   ] Got command RPT from MCS: ref #101637
2019-03-22 09:47:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101637  77 58564 35220003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:47:00 [DEBUG   ] Got command RPT from MCS: ref #101639
2019-03-22 09:47:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101639  12 58564 35220207 A  ERRORB’™š'
2019-03-22 09:47:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 09:47:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:47:28 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2019-03-22 09:47:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:47:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:47:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:47:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:47:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:47:28 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-03-22 09:47:41 [DEBUG   ] Got command RPT from MCS: ref #101643
2019-03-22 09:47:41 [DEBUG   ] summary = ERROR
2019-03-22 09:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101643  13 58564 35261047 A  ERRORERROR'
2019-03-22 09:47:41 [DEBUG   ] Got command RPT from MCS: ref #101644
2019-03-22 09:47:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101644  77 58564 35261047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:47:48 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2019-03-22 09:48:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 09:48:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:48:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:48:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:48:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:48:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:48:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:48:28 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-03-22 09:48:29 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 09:48:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 09:49:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 09:49:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:49:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:49:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:49:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:49:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:49:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:49:28 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-03-22 09:49:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 09:49:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 09:50:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 09:50:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:50:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:50:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:50:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:50:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:50:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:50:28 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-03-22 09:50:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 09:50:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 09:51:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 09:51:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:51:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:51:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:51:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:51:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:51:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:51:28 [DEBUG   ] Finished updating board flags in 1.476 seconds
2019-03-22 09:51:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 09:51:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 09:51:59 [DEBUG   ] Got command RPT from MCS: ref #101672
2019-03-22 09:51:59 [DEBUG   ] summary = ERROR
2019-03-22 09:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101672  13 58564 35519495 A  ERRORERROR'
2019-03-22 09:51:59 [DEBUG   ] Got command RPT from MCS: ref #101673
2019-03-22 09:51:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101673  77 58564 35519687 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:51:59 [DEBUG   ] Got command RPT from MCS: ref #101674
2019-03-22 09:51:59 [DEBUG   ] summary = ERROR
2019-03-22 09:51:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101674  13 58564 35519891 A  ERRORERROR'
2019-03-22 09:52:00 [DEBUG   ] Got command RPT from MCS: ref #101675
2019-03-22 09:52:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101675  77 58564 35520095 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:52:00 [DEBUG   ] Got command RPT from MCS: ref #101676
2019-03-22 09:52:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101676  12 58564 35520299 A  ERRORB”™š'
2019-03-22 09:52:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 09:52:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:52:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:52:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:52:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:52:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:52:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:52:28 [DEBUG   ] Finished updating board flags in 1.461 seconds
2019-03-22 09:52:29 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-03-22 09:52:41 [DEBUG   ] Got command RPT from MCS: ref #101677
2019-03-22 09:52:41 [DEBUG   ] summary = ERROR
2019-03-22 09:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101677  13 58564 35561051 A  ERRORERROR'
2019-03-22 09:52:41 [DEBUG   ] Got command RPT from MCS: ref #101678
2019-03-22 09:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101678  77 58564 35561051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:52:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 09:53:09 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 09:53:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:53:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:53:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:53:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:53:28 [WARNING ] (13, 1, 'bot')
2019-03-22 09:53:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:53:28 [DEBUG   ] Finished updating board flags in 1.490 seconds
2019-03-22 09:53:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 09:53:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 09:54:10 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 09:54:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:54:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:54:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:54:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:54:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:54:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:54:29 [DEBUG   ] Finished updating board flags in 2.227 seconds
2019-03-22 09:54:30 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 09:54:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 09:55:10 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-03-22 09:55:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:55:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:55:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:55:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:55:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:55:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:55:29 [DEBUG   ] Finished updating board flags in 2.155 seconds
2019-03-22 09:55:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 09:55:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 09:56:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 09:56:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:56:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:56:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:56:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:56:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:56:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:56:29 [DEBUG   ] Finished updating board flags in 2.038 seconds
2019-03-22 09:56:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 09:56:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 09:56:59 [DEBUG   ] Got command RPT from MCS: ref #101702
2019-03-22 09:56:59 [DEBUG   ] summary = ERROR
2019-03-22 09:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101702  13 58564 35819579 A  ERRORERROR'
2019-03-22 09:56:59 [DEBUG   ] Got command RPT from MCS: ref #101703
2019-03-22 09:56:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101703  77 58564 35819771 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:56:59 [DEBUG   ] Got command RPT from MCS: ref #101704
2019-03-22 09:56:59 [DEBUG   ] summary = ERROR
2019-03-22 09:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101704  13 58564 35819975 A  ERRORERROR'
2019-03-22 09:57:00 [DEBUG   ] Got command RPT from MCS: ref #101706
2019-03-22 09:57:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:57:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101706  77 58564 35820179 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:57:00 [DEBUG   ] Got command RPT from MCS: ref #101707
2019-03-22 09:57:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 09:57:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101707  12 58564 35820383 A  ERRORB”™š'
2019-03-22 09:57:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 09:57:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:57:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:57:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:57:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:57:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:57:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:57:29 [DEBUG   ] Finished updating board flags in 2.029 seconds
2019-03-22 09:57:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 09:57:41 [DEBUG   ] Got command RPT from MCS: ref #101718
2019-03-22 09:57:41 [DEBUG   ] summary = ERROR
2019-03-22 09:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101718  13 58564 35861051 A  ERRORERROR'
2019-03-22 09:57:41 [DEBUG   ] Got command RPT from MCS: ref #101719
2019-03-22 09:57:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 09:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101719  77 58564 35861051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 09:57:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 09:58:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 09:58:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:58:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:58:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:58:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:58:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:58:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:58:29 [DEBUG   ] Finished updating board flags in 1.925 seconds
2019-03-22 09:58:30 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-03-22 09:58:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 09:59:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 09:59:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 09:59:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 09:59:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:59:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:59:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:59:29 [WARNING ] (13, 1, 'bot')
2019-03-22 09:59:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 09:59:29 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-03-22 09:59:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 09:59:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 10:00:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 10:00:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:00:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 10:00:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:00:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:00:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:00:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:00:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:00:29 [DEBUG   ] Finished updating board flags in 1.599 seconds
2019-03-22 10:00:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 10:00:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 10:01:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 10:01:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:01:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:01:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:01:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:01:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:01:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:01:29 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-03-22 10:01:31 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-03-22 10:01:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 10:01:59 [DEBUG   ] Got command RPT from MCS: ref #101741
2019-03-22 10:01:59 [DEBUG   ] summary = ERROR
2019-03-22 10:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101741  13 58564 36119667 A  ERRORERROR'
2019-03-22 10:01:59 [DEBUG   ] Got command RPT from MCS: ref #101742
2019-03-22 10:01:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:01:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101742  77 58564 36119859 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:02:00 [DEBUG   ] Got command RPT from MCS: ref #101743
2019-03-22 10:02:00 [DEBUG   ] summary = ERROR
2019-03-22 10:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101743  13 58564 36120063 A  ERRORERROR'
2019-03-22 10:02:00 [DEBUG   ] Got command RPT from MCS: ref #101744
2019-03-22 10:02:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101744  77 58564 36120267 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:02:00 [DEBUG   ] Got command RPT from MCS: ref #101745
2019-03-22 10:02:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101745  12 58564 36120471 A  ERRORB“™š'
2019-03-22 10:02:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 10:02:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:02:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:02:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:02:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:02:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:02:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:02:29 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-03-22 10:02:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 10:02:41 [DEBUG   ] Got command RPT from MCS: ref #101746
2019-03-22 10:02:41 [DEBUG   ] summary = ERROR
2019-03-22 10:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101746  13 58564 36161051 A  ERRORERROR'
2019-03-22 10:02:41 [DEBUG   ] Got command RPT from MCS: ref #101747
2019-03-22 10:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101747  77 58564 36161051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:02:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 10:03:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 10:03:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:03:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:03:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:03:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:03:29 [WARNING ] (13, 1, 'bot')
2019-03-22 10:03:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:03:29 [DEBUG   ] Finished updating board flags in 1.379 seconds
2019-03-22 10:03:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 10:03:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 10:04:11 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 10:04:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:04:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:04:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:04:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:04:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:04:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:04:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:04:30 [DEBUG   ] Finished updating board flags in 2.220 seconds
2019-03-22 10:04:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:04:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 10:05:12 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 10:05:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:05:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:05:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:05:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:05:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:05:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:05:30 [DEBUG   ] Finished updating board flags in 2.177 seconds
2019-03-22 10:05:32 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 10:05:52 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 10:06:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-03-22 10:06:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:06:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:06:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:06:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:06:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:06:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:06:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:06:30 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-03-22 10:06:32 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 10:06:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 10:06:59 [DEBUG   ] Got command RPT from MCS: ref #101777
2019-03-22 10:06:59 [DEBUG   ] summary = ERROR
2019-03-22 10:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101777  13 58564 36419751 A  ERRORERROR'
2019-03-22 10:06:59 [DEBUG   ] Got command RPT from MCS: ref #101778
2019-03-22 10:06:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101778  77 58564 36419955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:07:00 [DEBUG   ] Got command RPT from MCS: ref #101779
2019-03-22 10:07:00 [DEBUG   ] summary = ERROR
2019-03-22 10:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101779  13 58564 36420147 A  ERRORERROR'
2019-03-22 10:07:00 [DEBUG   ] Got command RPT from MCS: ref #101781
2019-03-22 10:07:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101781  77 58564 36420351 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:07:00 [DEBUG   ] Got command RPT from MCS: ref #101783
2019-03-22 10:07:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101783  12 58564 36420555 A  ERRORB“™š'
2019-03-22 10:07:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 10:07:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:07:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:07:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:07:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:07:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:07:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:07:30 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-03-22 10:07:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 10:07:41 [DEBUG   ] Got command RPT from MCS: ref #101787
2019-03-22 10:07:41 [DEBUG   ] summary = ERROR
2019-03-22 10:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101787  13 58564 36461051 A  ERRORERROR'
2019-03-22 10:07:41 [DEBUG   ] Got command RPT from MCS: ref #101788
2019-03-22 10:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101788  77 58564 36461051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:07:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 10:08:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 10:08:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:08:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:08:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:08:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:08:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:08:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:08:30 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-03-22 10:08:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 10:08:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 10:09:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 10:09:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:09:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:09:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:09:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:09:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:09:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:09:30 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-03-22 10:09:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 10:09:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 10:10:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:10:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:10:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:10:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:10:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:10:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:10:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:10:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:10:30 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-03-22 10:10:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 10:10:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:11:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:11:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:11:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:11:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:11:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:11:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:11:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:11:30 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-03-22 10:11:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 10:11:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 10:11:59 [DEBUG   ] Got command RPT from MCS: ref #101810
2019-03-22 10:11:59 [DEBUG   ] summary = ERROR
2019-03-22 10:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101810  13 58564 36719835 A  ERRORERROR'
2019-03-22 10:12:00 [DEBUG   ] Got command RPT from MCS: ref #101811
2019-03-22 10:12:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101811  77 58564 36720039 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:12:00 [DEBUG   ] Got command RPT from MCS: ref #101812
2019-03-22 10:12:00 [DEBUG   ] summary = ERROR
2019-03-22 10:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101812  13 58564 36720231 A  ERRORERROR'
2019-03-22 10:12:00 [DEBUG   ] Got command RPT from MCS: ref #101813
2019-03-22 10:12:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101813  77 58564 36720439 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:12:00 [DEBUG   ] Got command RPT from MCS: ref #101814
2019-03-22 10:12:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101814  12 58564 36720639 A  ERRORB’™š'
2019-03-22 10:12:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 10:12:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:12:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:12:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:12:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:12:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:12:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:12:30 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-03-22 10:12:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 10:12:41 [DEBUG   ] Got command RPT from MCS: ref #101821
2019-03-22 10:12:41 [DEBUG   ] summary = ERROR
2019-03-22 10:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101821  13 58564 36761051 A  ERRORERROR'
2019-03-22 10:12:41 [DEBUG   ] Got command RPT from MCS: ref #101822
2019-03-22 10:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101822  77 58564 36761051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:12:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 10:13:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 10:13:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:13:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 10:13:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:13:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:13:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:13:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:13:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:13:30 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-03-22 10:13:33 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 10:13:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 10:14:13 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-03-22 10:14:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:14:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:14:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:14:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:14:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:14:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:14:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:14:30 [DEBUG   ] Finished updating board flags in 1.439 seconds
2019-03-22 10:14:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 10:14:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 10:15:11 [DEBUG   ] Got command TBW from MCS: ref #101845
2019-03-22 10:15:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-03-22 10:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   101845   8 58564 36911739 A  ERROR'
2019-03-22 10:15:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-03-22 10:15:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-03-22 10:15:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-03-22 10:15:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-03-22 10:15:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-03-22 10:15:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-03-22 10:15:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-03-22 10:15:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-03-22 10:15:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-03-22 10:15:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-03-22 10:15:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-03-22 10:15:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-03-22 10:15:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-03-22 10:15:15 [DEBUG   ] spawn_process: at 2019-03-22 10:15:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-03-22 10:15:15 [INFO    ] Finished spawning TBW
2019-03-22 10:15:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:15:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:15:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:15:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:15:30 [WARNING ] (13, 1, 'bot')
2019-03-22 10:15:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:15:30 [DEBUG   ] Finished updating board flags in 1.159 seconds
2019-03-22 10:16:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:16:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:16:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:16:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:16:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:16:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:16:31 [DEBUG   ] Finished updating board flags in 2.143 seconds
2019-03-22 10:16:59 [DEBUG   ] Got command RPT from MCS: ref #101852
2019-03-22 10:16:59 [DEBUG   ] summary = ERROR
2019-03-22 10:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101852  13 58564 37019923 A  ERRORERROR'
2019-03-22 10:17:00 [DEBUG   ] Got command RPT from MCS: ref #101853
2019-03-22 10:17:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101853  77 58564 37020127 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:17:00 [DEBUG   ] Got command RPT from MCS: ref #101854
2019-03-22 10:17:00 [DEBUG   ] summary = ERROR
2019-03-22 10:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101854  13 58564 37020319 A  ERRORERROR'
2019-03-22 10:17:00 [DEBUG   ] Got command RPT from MCS: ref #101856
2019-03-22 10:17:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101856  77 58564 37020523 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:17:00 [DEBUG   ] Got command RPT from MCS: ref #101857
2019-03-22 10:17:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101857  12 58564 37020727 A  ERRORB’™š'
2019-03-22 10:17:03 [INFO    ] __waitForTBW - TBW finished in 108.670 s
2019-03-22 10:17:04 [INFO    ] Started antennas statistics background thread
2019-03-22 10:17:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1553249826']
2019-03-22 10:17:04 [DEBUG   ] spawn_process: at 2019-03-22 10:17:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1553249826']
2019-03-22 10:17:04 [INFO    ] Finished spawning TBN in 0.061 s
2019-03-22 10:17:05 [DEBUG   ] Finished updating ant stats in 1.316 seconds
2019-03-22 10:17:25 [DEBUG   ] Finished updating ant stats in 1.268 seconds
2019-03-22 10:17:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:17:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:17:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:17:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:17:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:17:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:17:31 [DEBUG   ] Finished updating board flags in 2.172 seconds
2019-03-22 10:17:41 [DEBUG   ] Got command RPT from MCS: ref #101863
2019-03-22 10:17:41 [DEBUG   ] summary = ERROR
2019-03-22 10:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101863  13 58564 37061055 A  ERRORERROR'
2019-03-22 10:17:41 [DEBUG   ] Got command RPT from MCS: ref #101864
2019-03-22 10:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101864  77 58564 37061055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:17:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 10:18:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 10:18:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 10:18:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:18:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:18:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:18:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:18:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:18:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:18:31 [DEBUG   ] Finished updating board flags in 1.856 seconds
2019-03-22 10:18:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 10:19:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 10:19:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 10:19:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:19:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 10:19:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:19:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:19:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:19:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:19:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:19:31 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-03-22 10:19:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 10:20:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 10:20:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 10:20:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:20:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:20:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:20:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:20:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:20:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:20:31 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-03-22 10:20:45 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 10:21:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 10:21:26 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 10:21:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:21:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:21:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:21:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:21:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:21:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:21:31 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-03-22 10:21:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 10:22:00 [DEBUG   ] Got command RPT from MCS: ref #101894
2019-03-22 10:22:00 [DEBUG   ] summary = ERROR
2019-03-22 10:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101894  13 58564 37320007 A  ERRORERROR'
2019-03-22 10:22:00 [DEBUG   ] Got command RPT from MCS: ref #101895
2019-03-22 10:22:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101895  77 58564 37320211 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:22:00 [DEBUG   ] Got command RPT from MCS: ref #101896
2019-03-22 10:22:00 [DEBUG   ] summary = ERROR
2019-03-22 10:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101896  13 58564 37320415 A  ERRORERROR'
2019-03-22 10:22:00 [DEBUG   ] Got command RPT from MCS: ref #101897
2019-03-22 10:22:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101897  77 58564 37320607 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:22:00 [DEBUG   ] Got command RPT from MCS: ref #101898
2019-03-22 10:22:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101898  12 58564 37320811 A  ERRORB”™š'
2019-03-22 10:22:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 10:22:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 10:22:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:22:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 10:22:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:22:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:22:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:22:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:22:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:22:31 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-03-22 10:22:41 [DEBUG   ] Got command RPT from MCS: ref #101899
2019-03-22 10:22:41 [DEBUG   ] summary = ERROR
2019-03-22 10:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101899  13 58564 37361051 A  ERRORERROR'
2019-03-22 10:22:41 [DEBUG   ] Got command RPT from MCS: ref #101900
2019-03-22 10:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101900  77 58564 37361051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:22:46 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 10:23:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 10:23:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 10:23:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:23:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:23:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:23:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:23:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:23:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:23:31 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-03-22 10:23:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 10:24:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 10:24:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 10:24:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:24:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 10:24:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:24:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:24:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:24:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:24:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:24:31 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-03-22 10:24:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 10:25:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 10:25:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 10:25:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:25:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:25:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:25:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:25:31 [WARNING ] (13, 1, 'bot')
2019-03-22 10:25:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:25:31 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-03-22 10:25:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 10:26:07 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 10:26:27 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 10:26:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:26:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 10:26:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:26:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:26:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:26:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:26:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:26:32 [DEBUG   ] Finished updating board flags in 2.056 seconds
2019-03-22 10:26:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 10:27:00 [DEBUG   ] Got command RPT from MCS: ref #101924
2019-03-22 10:27:00 [DEBUG   ] summary = ERROR
2019-03-22 10:27:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101924  13 58564 37620099 A  ERRORERROR'
2019-03-22 10:27:00 [DEBUG   ] Got command RPT from MCS: ref #101925
2019-03-22 10:27:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:27:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101925  77 58564 37620291 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:27:00 [DEBUG   ] Got command RPT from MCS: ref #101926
2019-03-22 10:27:00 [DEBUG   ] summary = ERROR
2019-03-22 10:27:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101926  13 58564 37620495 A  ERRORERROR'
2019-03-22 10:27:00 [DEBUG   ] Got command RPT from MCS: ref #101928
2019-03-22 10:27:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:27:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101928  77 58564 37620699 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:27:00 [DEBUG   ] Got command RPT from MCS: ref #101930
2019-03-22 10:27:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:27:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101930  12 58564 37620903 A  ERRORB”™š'
2019-03-22 10:27:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-03-22 10:27:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-22 10:27:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:27:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:27:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:27:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:27:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:27:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:27:32 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-03-22 10:27:41 [DEBUG   ] Got command RPT from MCS: ref #101940
2019-03-22 10:27:41 [DEBUG   ] summary = ERROR
2019-03-22 10:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101940  13 58564 37661051 A  ERRORERROR'
2019-03-22 10:27:41 [DEBUG   ] Got command RPT from MCS: ref #101941
2019-03-22 10:27:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101941  77 58564 37661051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:27:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 10:28:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 10:28:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 10:28:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:28:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:28:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:28:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:28:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:28:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:28:32 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-03-22 10:28:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 10:29:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 10:29:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 10:29:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 10:29:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:29:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:29:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:29:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:29:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:29:32 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-03-22 10:29:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 10:30:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 10:30:27 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-22 10:30:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:30:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:30:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:30:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:30:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:30:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:30:32 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-03-22 10:30:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 10:31:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 10:31:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 10:31:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:31:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:31:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:31:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:31:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:31:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:31:32 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-03-22 10:31:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 10:32:00 [DEBUG   ] Got command RPT from MCS: ref #101963
2019-03-22 10:32:00 [DEBUG   ] summary = ERROR
2019-03-22 10:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101963  13 58564 37920175 A  ERRORERROR'
2019-03-22 10:32:00 [DEBUG   ] Got command RPT from MCS: ref #101964
2019-03-22 10:32:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101964  77 58564 37920379 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:32:00 [DEBUG   ] Got command RPT from MCS: ref #101965
2019-03-22 10:32:00 [DEBUG   ] summary = ERROR
2019-03-22 10:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101965  13 58564 37920583 A  ERRORERROR'
2019-03-22 10:32:00 [DEBUG   ] Got command RPT from MCS: ref #101966
2019-03-22 10:32:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101966  77 58564 37920787 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:32:00 [DEBUG   ] Got command RPT from MCS: ref #101967
2019-03-22 10:32:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101967  12 58564 37920979 A  ERRORB“™š'
2019-03-22 10:32:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 10:32:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-03-22 10:32:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:32:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:32:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:32:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:32:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:32:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:32:32 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-03-22 10:32:41 [DEBUG   ] Got command RPT from MCS: ref #101968
2019-03-22 10:32:41 [DEBUG   ] summary = ERROR
2019-03-22 10:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101968  13 58564 37961055 A  ERRORERROR'
2019-03-22 10:32:41 [DEBUG   ] Got command RPT from MCS: ref #101969
2019-03-22 10:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101969  77 58564 37961055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:32:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 10:33:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 10:33:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-03-22 10:33:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:33:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:33:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:33:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:33:32 [WARNING ] (13, 1, 'bot')
2019-03-22 10:33:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:33:32 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-03-22 10:33:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 10:34:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:34:29 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 10:34:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:34:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:34:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:34:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:34:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:34:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:34:33 [DEBUG   ] Finished updating board flags in 2.052 seconds
2019-03-22 10:34:49 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-03-22 10:35:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 10:35:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 10:35:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:35:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:35:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:35:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:35:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:35:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:35:33 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-03-22 10:35:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 10:36:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 10:36:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 10:36:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:36:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:36:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:36:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:36:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:36:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:36:33 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-03-22 10:36:49 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 10:37:00 [DEBUG   ] Got command RPT from MCS: ref #101999
2019-03-22 10:37:00 [DEBUG   ] summary = ERROR
2019-03-22 10:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   101999  13 58564 38220267 A  ERRORERROR'
2019-03-22 10:37:00 [DEBUG   ] Got command RPT from MCS: ref #102000
2019-03-22 10:37:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102000  77 58564 38220459 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:37:00 [DEBUG   ] Got command RPT from MCS: ref #102001
2019-03-22 10:37:00 [DEBUG   ] summary = ERROR
2019-03-22 10:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102001  13 58564 38220663 A  ERRORERROR'
2019-03-22 10:37:00 [DEBUG   ] Got command RPT from MCS: ref #102003
2019-03-22 10:37:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102003  77 58564 38220867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:37:01 [DEBUG   ] Got command RPT from MCS: ref #102005
2019-03-22 10:37:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102005  12 58564 38221071 A  ERRORB“™š'
2019-03-22 10:37:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 10:37:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 10:37:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 10:37:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:37:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:37:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:37:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:37:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:37:33 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-03-22 10:37:41 [DEBUG   ] Got command RPT from MCS: ref #102009
2019-03-22 10:37:41 [DEBUG   ] summary = ERROR
2019-03-22 10:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102009  13 58564 38261059 A  ERRORERROR'
2019-03-22 10:37:41 [DEBUG   ] Got command RPT from MCS: ref #102010
2019-03-22 10:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102010  77 58564 38261059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:37:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 10:38:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 10:38:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 10:38:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:38:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:38:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:38:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:38:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:38:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:38:33 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-03-22 10:38:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-03-22 10:39:10 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2019-03-22 10:39:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 10:39:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:39:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:39:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:39:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:39:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:39:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:39:33 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-03-22 10:39:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 10:40:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 10:40:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 10:40:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:40:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:40:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:40:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:40:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:40:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:40:33 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-03-22 10:40:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 10:41:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 10:41:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 10:41:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:41:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:41:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:41:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:41:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:41:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:41:33 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-03-22 10:41:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 10:42:00 [DEBUG   ] Got command RPT from MCS: ref #102032
2019-03-22 10:42:00 [DEBUG   ] summary = ERROR
2019-03-22 10:42:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102032  13 58564 38520351 A  ERRORERROR'
2019-03-22 10:42:00 [DEBUG   ] Got command RPT from MCS: ref #102033
2019-03-22 10:42:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:42:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102033  77 58564 38520555 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:42:00 [DEBUG   ] Got command RPT from MCS: ref #102034
2019-03-22 10:42:00 [DEBUG   ] summary = ERROR
2019-03-22 10:42:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102034  13 58564 38520747 A  ERRORERROR'
2019-03-22 10:42:00 [DEBUG   ] Got command RPT from MCS: ref #102035
2019-03-22 10:42:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:42:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102035  77 58564 38520951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:42:01 [DEBUG   ] Got command RPT from MCS: ref #102036
2019-03-22 10:42:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102036  12 58564 38521155 A  ERRORB’™š'
2019-03-22 10:42:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 10:42:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 10:42:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:42:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:42:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:42:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:42:33 [WARNING ] (13, 1, 'bot')
2019-03-22 10:42:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:42:33 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-03-22 10:42:41 [DEBUG   ] Got command RPT from MCS: ref #102043
2019-03-22 10:42:41 [DEBUG   ] summary = ERROR
2019-03-22 10:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102043  13 58564 38561059 A  ERRORERROR'
2019-03-22 10:42:41 [DEBUG   ] Got command RPT from MCS: ref #102044
2019-03-22 10:42:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102044  77 58564 38561059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:42:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 10:43:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 10:43:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 10:43:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:43:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:43:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:43:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:43:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:43:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:43:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:43:34 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-03-22 10:43:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 10:44:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 10:44:31 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 10:44:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:44:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:44:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:44:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:44:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:44:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:44:34 [DEBUG   ] Finished updating board flags in 2.175 seconds
2019-03-22 10:44:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 10:45:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 10:45:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-03-22 10:45:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:45:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:45:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:45:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:45:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:45:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:45:34 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-03-22 10:45:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-22 10:46:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 10:46:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 10:46:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:46:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:46:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:46:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:46:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:46:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:46:34 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-03-22 10:46:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 10:47:00 [DEBUG   ] Got command RPT from MCS: ref #102068
2019-03-22 10:47:00 [DEBUG   ] summary = ERROR
2019-03-22 10:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102068  13 58564 38820437 A  ERRORERROR'
2019-03-22 10:47:00 [DEBUG   ] Got command RPT from MCS: ref #102069
2019-03-22 10:47:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102069  77 58564 38820639 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:47:00 [DEBUG   ] Got command RPT from MCS: ref #102070
2019-03-22 10:47:00 [DEBUG   ] summary = ERROR
2019-03-22 10:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102070  13 58564 38820831 A  ERRORERROR'
2019-03-22 10:47:01 [DEBUG   ] Got command RPT from MCS: ref #102072
2019-03-22 10:47:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102072  77 58564 38821035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:47:01 [DEBUG   ] Got command RPT from MCS: ref #102073
2019-03-22 10:47:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102073  12 58564 38821239 A  ERRORB’™š'
2019-03-22 10:47:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 10:47:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 10:47:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:47:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:47:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:47:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:47:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:47:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:47:34 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-03-22 10:47:41 [DEBUG   ] Got command RPT from MCS: ref #102078
2019-03-22 10:47:41 [DEBUG   ] summary = ERROR
2019-03-22 10:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102078  13 58564 38861059 A  ERRORERROR'
2019-03-22 10:47:41 [DEBUG   ] Got command RPT from MCS: ref #102079
2019-03-22 10:47:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102079  77 58564 38861059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:47:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 10:48:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 10:48:31 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-03-22 10:48:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:48:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:48:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:48:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:48:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:48:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:48:34 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-03-22 10:48:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:49:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:49:32 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 10:49:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 10:49:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:49:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:49:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:49:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:49:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:49:34 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-03-22 10:49:52 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 10:50:12 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 10:50:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 10:50:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:50:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:50:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:50:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:50:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:50:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:50:34 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-03-22 10:50:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 10:51:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 10:51:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 10:51:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:51:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:51:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:51:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:51:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:51:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:51:34 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-03-22 10:51:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 10:52:00 [DEBUG   ] Got command RPT from MCS: ref #102107
2019-03-22 10:52:00 [DEBUG   ] summary = ERROR
2019-03-22 10:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102107  13 58564 39120519 A  ERRORERROR'
2019-03-22 10:52:00 [DEBUG   ] Got command RPT from MCS: ref #102108
2019-03-22 10:52:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102108  77 58564 39120723 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:52:00 [DEBUG   ] Got command RPT from MCS: ref #102109
2019-03-22 10:52:00 [DEBUG   ] summary = ERROR
2019-03-22 10:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102109  13 58564 39120927 A  ERRORERROR'
2019-03-22 10:52:01 [DEBUG   ] Got command RPT from MCS: ref #102110
2019-03-22 10:52:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102110  77 58564 39121119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:52:01 [DEBUG   ] Got command RPT from MCS: ref #102111
2019-03-22 10:52:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102111  12 58564 39121323 A  ERRORB“™š'
2019-03-22 10:52:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-03-22 10:52:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 10:52:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:52:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:52:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:52:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:52:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:52:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:52:34 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-03-22 10:52:41 [DEBUG   ] Got command RPT from MCS: ref #102112
2019-03-22 10:52:41 [DEBUG   ] summary = ERROR
2019-03-22 10:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102112  13 58564 39161055 A  ERRORERROR'
2019-03-22 10:52:41 [DEBUG   ] Got command RPT from MCS: ref #102113
2019-03-22 10:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102113  77 58564 39161055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:52:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 10:53:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 10:53:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 10:53:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:53:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:53:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:53:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:53:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:53:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:53:34 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-03-22 10:53:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:54:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:54:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:54:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:54:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:54:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:54:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:54:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:54:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:54:34 [DEBUG   ] Finished updating board flags in 1.658 seconds
2019-03-22 10:54:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 10:55:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:55:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:55:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 10:55:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:55:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:55:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:55:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:55:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:55:34 [DEBUG   ] Finished updating board flags in 1.532 seconds
2019-03-22 10:55:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 10:56:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 10:56:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:56:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:56:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:56:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:56:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:56:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:56:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:56:34 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-03-22 10:56:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:57:00 [DEBUG   ] Got command RPT from MCS: ref #102137
2019-03-22 10:57:00 [DEBUG   ] summary = ERROR
2019-03-22 10:57:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102137  13 58564 39420603 A  ERRORERROR'
2019-03-22 10:57:00 [DEBUG   ] Got command RPT from MCS: ref #102138
2019-03-22 10:57:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:57:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102138  77 58564 39420807 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:57:01 [DEBUG   ] Got command RPT from MCS: ref #102139
2019-03-22 10:57:01 [DEBUG   ] summary = ERROR
2019-03-22 10:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102139  13 58564 39421011 A  ERRORERROR'
2019-03-22 10:57:01 [DEBUG   ] Got command RPT from MCS: ref #102141
2019-03-22 10:57:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102141  77 58564 39421215 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:57:01 [DEBUG   ] Got command RPT from MCS: ref #102142
2019-03-22 10:57:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 10:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102142  12 58564 39421407 A  ERRORB”™š'
2019-03-22 10:57:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 10:57:33 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 10:57:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 10:57:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:57:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:57:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:57:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:57:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:57:34 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-03-22 10:57:41 [DEBUG   ] Got command RPT from MCS: ref #102153
2019-03-22 10:57:41 [DEBUG   ] summary = ERROR
2019-03-22 10:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102153  13 58564 39461067 A  ERRORERROR'
2019-03-22 10:57:41 [DEBUG   ] Got command RPT from MCS: ref #102154
2019-03-22 10:57:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 10:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102154  77 58564 39461067 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 10:57:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 10:58:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 10:58:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 10:58:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:58:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:58:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:58:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:58:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:58:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:58:34 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-03-22 10:58:53 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-03-22 10:59:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 10:59:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 10:59:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 10:59:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:59:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:59:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:59:34 [WARNING ] (13, 1, 'bot')
2019-03-22 10:59:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 10:59:34 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-03-22 10:59:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 11:00:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 11:00:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 11:00:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:00:34 [WARNING ] (13, 1, 'bot')
2019-03-22 11:00:34 [WARNING ] (13, 1, 'bot')
2019-03-22 11:00:34 [WARNING ] (13, 1, 'bot')
2019-03-22 11:00:34 [WARNING ] (13, 1, 'bot')
2019-03-22 11:00:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:00:34 [DEBUG   ] Finished updating board flags in 1.464 seconds
2019-03-22 11:00:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 11:01:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-03-22 11:01:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:01:34 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-03-22 11:01:34 [WARNING ] (13, 1, 'bot')
2019-03-22 11:01:34 [WARNING ] (13, 1, 'bot')
2019-03-22 11:01:34 [WARNING ] (13, 1, 'bot')
2019-03-22 11:01:34 [WARNING ] (13, 1, 'bot')
2019-03-22 11:01:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:01:34 [DEBUG   ] Finished updating board flags in 1.459 seconds
2019-03-22 11:01:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 11:02:00 [DEBUG   ] Got command RPT from MCS: ref #102176
2019-03-22 11:02:00 [DEBUG   ] summary = ERROR
2019-03-22 11:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102176  13 58564 39720695 A  ERRORERROR'
2019-03-22 11:02:00 [DEBUG   ] Got command RPT from MCS: ref #102177
2019-03-22 11:02:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102177  77 58564 39720887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:02:01 [DEBUG   ] Got command RPT from MCS: ref #102178
2019-03-22 11:02:01 [DEBUG   ] summary = ERROR
2019-03-22 11:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102178  13 58564 39721091 A  ERRORERROR'
2019-03-22 11:02:01 [DEBUG   ] Got command RPT from MCS: ref #102179
2019-03-22 11:02:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102179  77 58564 39721295 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:02:01 [DEBUG   ] Got command RPT from MCS: ref #102180
2019-03-22 11:02:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102180  12 58564 39721499 A  ERRORB”™š'
2019-03-22 11:02:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 11:02:34 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2019-03-22 11:02:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:02:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:02:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:02:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:02:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:02:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:02:35 [DEBUG   ] Finished updating board flags in 2.223 seconds
2019-03-22 11:02:41 [DEBUG   ] Got command RPT from MCS: ref #102181
2019-03-22 11:02:41 [DEBUG   ] summary = ERROR
2019-03-22 11:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102181  13 58564 39761063 A  ERRORERROR'
2019-03-22 11:02:41 [DEBUG   ] Got command RPT from MCS: ref #102182
2019-03-22 11:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102182  77 58564 39761063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:02:54 [DEBUG   ] Finished updating ant stats in 1.148 seconds
2019-03-22 11:03:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:03:34 [DEBUG   ] Finished updating ant stats in 1.055 seconds
2019-03-22 11:03:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:03:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:03:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:03:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:03:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:03:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:03:35 [DEBUG   ] Finished updating board flags in 2.166 seconds
2019-03-22 11:03:54 [DEBUG   ] Finished updating ant stats in 0.947 seconds
2019-03-22 11:04:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 11:04:34 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2019-03-22 11:04:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:04:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:04:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:04:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:04:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:04:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:04:35 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-03-22 11:04:54 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-03-22 11:05:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 11:05:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:05:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 11:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:05:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:05:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:05:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:05:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:05:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:05:35 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-03-22 11:05:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 11:06:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:06:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:06:35 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2019-03-22 11:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:06:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:06:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:06:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:06:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:06:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:06:35 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-03-22 11:06:55 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2019-03-22 11:07:00 [DEBUG   ] Got command RPT from MCS: ref #102212
2019-03-22 11:07:00 [DEBUG   ] summary = ERROR
2019-03-22 11:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102212  13 58564 40020775 A  ERRORERROR'
2019-03-22 11:07:00 [DEBUG   ] Got command RPT from MCS: ref #102213
2019-03-22 11:07:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102213  77 58564 40020979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:07:01 [DEBUG   ] Got command RPT from MCS: ref #102214
2019-03-22 11:07:01 [DEBUG   ] summary = ERROR
2019-03-22 11:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102214  13 58564 40021171 A  ERRORERROR'
2019-03-22 11:07:01 [DEBUG   ] Got command RPT from MCS: ref #102216
2019-03-22 11:07:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102216  77 58564 40021375 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:07:01 [DEBUG   ] Got command RPT from MCS: ref #102217
2019-03-22 11:07:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102217  12 58564 40021579 A  ERRORB“™š'
2019-03-22 11:07:15 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-03-22 11:07:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:07:35 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2019-03-22 11:07:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:07:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:07:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:07:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:07:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:07:35 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-03-22 11:07:41 [DEBUG   ] Got command RPT from MCS: ref #102222
2019-03-22 11:07:41 [DEBUG   ] summary = ERROR
2019-03-22 11:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102222  13 58564 40061063 A  ERRORERROR'
2019-03-22 11:07:41 [DEBUG   ] Got command RPT from MCS: ref #102223
2019-03-22 11:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102223  77 58564 40061063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:07:55 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2019-03-22 11:08:16 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 11:08:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:08:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:08:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:08:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:08:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:08:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:08:35 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-03-22 11:08:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 11:08:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 11:09:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 11:09:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:09:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:09:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:09:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:09:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:09:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:09:35 [DEBUG   ] Finished updating board flags in 1.773 seconds
2019-03-22 11:09:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:09:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-03-22 11:10:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 11:10:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:10:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 11:10:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:10:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:10:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:10:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:10:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:10:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:10:35 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-03-22 11:10:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:10:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:11:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 11:11:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:11:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:11:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:11:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:11:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:11:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:11:35 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-03-22 11:11:36 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 11:11:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 11:12:00 [DEBUG   ] Got command RPT from MCS: ref #102245
2019-03-22 11:12:00 [DEBUG   ] summary = ERROR
2019-03-22 11:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102245  13 58564 40320859 A  ERRORERROR'
2019-03-22 11:12:01 [DEBUG   ] Got command RPT from MCS: ref #102246
2019-03-22 11:12:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102246  77 58564 40321063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:12:01 [DEBUG   ] Got command RPT from MCS: ref #102247
2019-03-22 11:12:01 [DEBUG   ] summary = ERROR
2019-03-22 11:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102247  13 58564 40321267 A  ERRORERROR'
2019-03-22 11:12:01 [DEBUG   ] Got command RPT from MCS: ref #102248
2019-03-22 11:12:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102248  77 58564 40321459 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:12:01 [DEBUG   ] Got command RPT from MCS: ref #102249
2019-03-22 11:12:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102249  12 58564 40321663 A  ERRORB“™š'
2019-03-22 11:12:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 11:12:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:12:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:12:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:12:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:12:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:12:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:12:35 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-03-22 11:12:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:12:41 [DEBUG   ] Got command RPT from MCS: ref #102256
2019-03-22 11:12:41 [DEBUG   ] summary = ERROR
2019-03-22 11:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102256  13 58564 40361063 A  ERRORERROR'
2019-03-22 11:12:41 [DEBUG   ] Got command RPT from MCS: ref #102257
2019-03-22 11:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102257  77 58564 40361063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:12:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 11:13:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 11:13:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:13:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:13:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:13:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:13:35 [WARNING ] (13, 1, 'bot')
2019-03-22 11:13:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:13:35 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-03-22 11:13:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 11:13:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-03-22 11:14:17 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 11:14:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:14:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:14:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:14:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:14:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:14:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:14:36 [DEBUG   ] Finished updating board flags in 2.260 seconds
2019-03-22 11:14:37 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 11:14:57 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 11:15:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-03-22 11:15:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:15:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:15:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:15:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:15:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:15:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:15:36 [DEBUG   ] Finished updating board flags in 2.156 seconds
2019-03-22 11:15:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 11:15:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 11:16:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:16:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:16:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:16:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:16:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:16:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:16:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:16:36 [DEBUG   ] Finished updating board flags in 2.034 seconds
2019-03-22 11:16:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 11:16:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:17:00 [DEBUG   ] Got command RPT from MCS: ref #102281
2019-03-22 11:17:00 [DEBUG   ] summary = ERROR
2019-03-22 11:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102281  13 58564 40620943 A  ERRORERROR'
2019-03-22 11:17:01 [DEBUG   ] Got command RPT from MCS: ref #102282
2019-03-22 11:17:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102282  77 58564 40621147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:17:01 [DEBUG   ] Got command RPT from MCS: ref #102283
2019-03-22 11:17:01 [DEBUG   ] summary = ERROR
2019-03-22 11:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102283  13 58564 40621351 A  ERRORERROR'
2019-03-22 11:17:01 [DEBUG   ] Got command RPT from MCS: ref #102284
2019-03-22 11:17:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102284  77 58564 40621543 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:17:01 [DEBUG   ] Got command RPT from MCS: ref #102286
2019-03-22 11:17:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102286  12 58564 40621747 A  ERRORB’™š'
2019-03-22 11:17:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:17:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:17:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:17:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:17:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:17:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:17:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:17:36 [DEBUG   ] Finished updating board flags in 1.959 seconds
2019-03-22 11:17:37 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 11:17:41 [DEBUG   ] Got command RPT from MCS: ref #102291
2019-03-22 11:17:41 [DEBUG   ] summary = ERROR
2019-03-22 11:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102291  13 58564 40661067 A  ERRORERROR'
2019-03-22 11:17:41 [DEBUG   ] Got command RPT from MCS: ref #102292
2019-03-22 11:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102292  77 58564 40661067 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:17:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:18:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 11:18:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:18:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:18:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:18:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:18:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:18:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:18:36 [DEBUG   ] Finished updating board flags in 1.830 seconds
2019-03-22 11:18:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 11:18:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:19:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:19:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:19:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:19:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:19:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:19:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:19:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:19:36 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-03-22 11:19:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 11:19:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 11:20:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 11:20:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:20:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:20:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:20:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:20:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:20:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:20:36 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-03-22 11:20:38 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-03-22 11:20:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 11:21:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 11:21:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:21:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:21:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:21:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:21:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:21:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:21:36 [DEBUG   ] Finished updating board flags in 1.738 seconds
2019-03-22 11:21:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 11:21:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 11:22:01 [DEBUG   ] Got command RPT from MCS: ref #102320
2019-03-22 11:22:01 [DEBUG   ] summary = ERROR
2019-03-22 11:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102320  13 58564 40921035 A  ERRORERROR'
2019-03-22 11:22:01 [DEBUG   ] Got command RPT from MCS: ref #102321
2019-03-22 11:22:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102321  77 58564 40921227 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:22:01 [DEBUG   ] Got command RPT from MCS: ref #102322
2019-03-22 11:22:01 [DEBUG   ] summary = ERROR
2019-03-22 11:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102322  13 58564 40921431 A  ERRORERROR'
2019-03-22 11:22:01 [DEBUG   ] Got command RPT from MCS: ref #102323
2019-03-22 11:22:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102323  77 58564 40921635 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:22:01 [DEBUG   ] Got command RPT from MCS: ref #102324
2019-03-22 11:22:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102324  12 58564 40921839 A  ERRORB’™š'
2019-03-22 11:22:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:22:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:22:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:22:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:22:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:22:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:22:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:22:36 [DEBUG   ] Finished updating board flags in 1.634 seconds
2019-03-22 11:22:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 11:22:41 [DEBUG   ] Got command RPT from MCS: ref #102325
2019-03-22 11:22:41 [DEBUG   ] summary = ERROR
2019-03-22 11:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102325  13 58564 40961067 A  ERRORERROR'
2019-03-22 11:22:41 [DEBUG   ] Got command RPT from MCS: ref #102326
2019-03-22 11:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102326  77 58564 40961067 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:22:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:23:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:23:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:23:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:23:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:23:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:23:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:23:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:23:36 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-03-22 11:23:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 11:23:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 11:24:19 [DEBUG   ] Finished updating ant stats in 1.801 seconds
2019-03-22 11:24:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:24:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:24:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:24:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:24:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:24:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:24:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:24:36 [DEBUG   ] Finished updating board flags in 1.402 seconds
2019-03-22 11:24:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 11:24:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-03-22 11:25:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 11:25:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:25:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:25:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:25:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:25:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:25:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:25:36 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-03-22 11:25:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 11:25:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 11:26:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 11:26:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:26:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:26:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:26:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:26:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:26:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:26:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:26:36 [DEBUG   ] Finished updating board flags in 1.461 seconds
2019-03-22 11:26:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 11:26:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 11:27:01 [DEBUG   ] Got command RPT from MCS: ref #102350
2019-03-22 11:27:01 [DEBUG   ] summary = ERROR
2019-03-22 11:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102350  13 58564 41221111 A  ERRORERROR'
2019-03-22 11:27:01 [DEBUG   ] Got command RPT from MCS: ref #102351
2019-03-22 11:27:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102351  77 58564 41221315 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:27:01 [DEBUG   ] Got command RPT from MCS: ref #102352
2019-03-22 11:27:01 [DEBUG   ] summary = ERROR
2019-03-22 11:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102352  13 58564 41221519 A  ERRORERROR'
2019-03-22 11:27:01 [DEBUG   ] Got command RPT from MCS: ref #102354
2019-03-22 11:27:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102354  77 58564 41221723 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:27:01 [DEBUG   ] Got command RPT from MCS: ref #102356
2019-03-22 11:27:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102356  12 58564 41221919 A  ERRORB’™š'
2019-03-22 11:27:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 11:27:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:27:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:27:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:27:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:27:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:27:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:27:36 [DEBUG   ] Finished updating board flags in 1.460 seconds
2019-03-22 11:27:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 11:27:41 [DEBUG   ] Got command RPT from MCS: ref #102366
2019-03-22 11:27:41 [DEBUG   ] summary = ERROR
2019-03-22 11:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102366  13 58564 41261075 A  ERRORERROR'
2019-03-22 11:27:41 [DEBUG   ] Got command RPT from MCS: ref #102367
2019-03-22 11:27:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102367  77 58564 41261075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:27:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 11:28:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 11:28:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:28:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2019-03-22 11:28:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:28:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:28:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:28:36 [WARNING ] (13, 1, 'bot')
2019-03-22 11:28:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:28:36 [DEBUG   ] Finished updating board flags in 1.468 seconds
2019-03-22 11:28:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:28:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:29:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:29:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:29:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:29:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:29:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:29:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:29:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:29:37 [DEBUG   ] Finished updating board flags in 2.209 seconds
2019-03-22 11:29:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:29:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-03-22 11:30:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 11:30:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:30:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:30:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:30:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:30:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:30:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:30:37 [DEBUG   ] Finished updating board flags in 2.152 seconds
2019-03-22 11:30:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 11:30:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 11:31:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:31:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:31:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:31:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:31:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:31:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:31:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:31:37 [DEBUG   ] Finished updating board flags in 2.046 seconds
2019-03-22 11:31:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 11:32:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 11:32:01 [DEBUG   ] Got command RPT from MCS: ref #102389
2019-03-22 11:32:01 [DEBUG   ] summary = ERROR
2019-03-22 11:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102389  13 58564 41521207 A  ERRORERROR'
2019-03-22 11:32:01 [DEBUG   ] Got command RPT from MCS: ref #102390
2019-03-22 11:32:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102390  77 58564 41521399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:32:01 [DEBUG   ] Got command RPT from MCS: ref #102391
2019-03-22 11:32:01 [DEBUG   ] summary = ERROR
2019-03-22 11:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102391  13 58564 41521603 A  ERRORERROR'
2019-03-22 11:32:01 [DEBUG   ] Got command RPT from MCS: ref #102392
2019-03-22 11:32:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102392  77 58564 41521807 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:32:02 [DEBUG   ] Got command RPT from MCS: ref #102393
2019-03-22 11:32:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102393  12 58564 41522011 A  ERRORB”™š'
2019-03-22 11:32:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 11:32:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:32:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:32:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:32:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:32:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:32:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:32:37 [DEBUG   ] Finished updating board flags in 1.962 seconds
2019-03-22 11:32:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-03-22 11:32:41 [DEBUG   ] Got command RPT from MCS: ref #102394
2019-03-22 11:32:41 [DEBUG   ] summary = ERROR
2019-03-22 11:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102394  13 58564 41561067 A  ERRORERROR'
2019-03-22 11:32:41 [DEBUG   ] Got command RPT from MCS: ref #102395
2019-03-22 11:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102395  77 58564 41561067 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:33:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 11:33:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 11:33:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:33:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:33:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:33:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:33:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:33:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:33:37 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-03-22 11:33:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:34:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 11:34:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:34:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:34:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:34:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:34:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:34:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:34:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:34:37 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-03-22 11:34:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:35:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:35:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:35:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:35:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-03-22 11:35:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:35:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:35:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:35:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:35:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:35:37 [DEBUG   ] Finished updating board flags in 1.669 seconds
2019-03-22 11:35:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:36:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:36:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:36:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:36:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:36:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:36:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:36:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:36:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:36:37 [DEBUG   ] Finished updating board flags in 1.541 seconds
2019-03-22 11:36:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:37:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:37:01 [DEBUG   ] Got command RPT from MCS: ref #102425
2019-03-22 11:37:01 [DEBUG   ] summary = ERROR
2019-03-22 11:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102425  13 58564 41821291 A  ERRORERROR'
2019-03-22 11:37:01 [DEBUG   ] Got command RPT from MCS: ref #102426
2019-03-22 11:37:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102426  77 58564 41821495 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:37:01 [DEBUG   ] Got command RPT from MCS: ref #102427
2019-03-22 11:37:01 [DEBUG   ] summary = ERROR
2019-03-22 11:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102427  13 58564 41821687 A  ERRORERROR'
2019-03-22 11:37:01 [DEBUG   ] Got command RPT from MCS: ref #102429
2019-03-22 11:37:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102429  77 58564 41821891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:37:02 [DEBUG   ] Got command RPT from MCS: ref #102431
2019-03-22 11:37:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102431  12 58564 41822095 A  ERRORB”™š'
2019-03-22 11:37:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:37:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:37:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:37:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:37:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:37:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:37:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:37:37 [DEBUG   ] Finished updating board flags in 1.440 seconds
2019-03-22 11:37:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:37:41 [DEBUG   ] Got command RPT from MCS: ref #102435
2019-03-22 11:37:41 [DEBUG   ] summary = ERROR
2019-03-22 11:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102435  13 58564 41861071 A  ERRORERROR'
2019-03-22 11:37:41 [DEBUG   ] Got command RPT from MCS: ref #102436
2019-03-22 11:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102436  77 58564 41861071 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:38:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:38:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 11:38:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:38:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:38:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:38:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:38:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:38:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:38:37 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-03-22 11:38:40 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-03-22 11:39:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 11:39:21 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2019-03-22 11:39:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:39:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:39:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:39:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:39:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:39:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:39:37 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-03-22 11:39:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 11:40:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 11:40:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 11:40:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:40:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:40:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:40:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:40:37 [WARNING ] (13, 1, 'bot')
2019-03-22 11:40:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:40:37 [DEBUG   ] Finished updating board flags in 1.513 seconds
2019-03-22 11:40:40 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2019-03-22 11:41:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 11:41:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 11:41:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:41:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:41:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:41:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:41:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:41:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:41:38 [DEBUG   ] Finished updating board flags in 2.232 seconds
2019-03-22 11:41:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 11:42:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 11:42:01 [DEBUG   ] Got command RPT from MCS: ref #102458
2019-03-22 11:42:01 [DEBUG   ] summary = ERROR
2019-03-22 11:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102458  13 58564 42121379 A  ERRORERROR'
2019-03-22 11:42:01 [DEBUG   ] Got command RPT from MCS: ref #102459
2019-03-22 11:42:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102459  77 58564 42121583 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:42:01 [DEBUG   ] Got command RPT from MCS: ref #102460
2019-03-22 11:42:01 [DEBUG   ] summary = ERROR
2019-03-22 11:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102460  13 58564 42121775 A  ERRORERROR'
2019-03-22 11:42:01 [DEBUG   ] Got command RPT from MCS: ref #102461
2019-03-22 11:42:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102461  77 58564 42121979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:42:02 [DEBUG   ] Got command RPT from MCS: ref #102462
2019-03-22 11:42:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102462  12 58564 42122183 A  ERRORB“™š'
2019-03-22 11:42:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 11:42:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:42:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:42:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:42:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:42:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:42:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:42:38 [DEBUG   ] Finished updating board flags in 2.147 seconds
2019-03-22 11:42:41 [DEBUG   ] Got command RPT from MCS: ref #102469
2019-03-22 11:42:41 [DEBUG   ] summary = ERROR
2019-03-22 11:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102469  13 58564 42161071 A  ERRORERROR'
2019-03-22 11:42:41 [DEBUG   ] Got command RPT from MCS: ref #102470
2019-03-22 11:42:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102470  77 58564 42161071 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:42:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:43:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 11:43:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:43:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:43:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:43:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:43:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:43:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:43:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:43:38 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-03-22 11:43:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:44:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:44:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:44:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:44:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:44:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:44:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:44:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:44:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:44:38 [DEBUG   ] Finished updating board flags in 2.032 seconds
2019-03-22 11:44:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:45:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:45:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:45:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:45:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:45:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:45:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:45:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:45:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:45:38 [DEBUG   ] Finished updating board flags in 2.031 seconds
2019-03-22 11:45:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:46:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 11:46:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 11:46:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:46:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:46:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:46:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:46:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:46:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:46:38 [DEBUG   ] Finished updating board flags in 1.928 seconds
2019-03-22 11:46:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:47:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 11:47:01 [DEBUG   ] Got command RPT from MCS: ref #102494
2019-03-22 11:47:01 [DEBUG   ] summary = ERROR
2019-03-22 11:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102494  13 58564 42421459 A  ERRORERROR'
2019-03-22 11:47:01 [DEBUG   ] Got command RPT from MCS: ref #102495
2019-03-22 11:47:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102495  77 58564 42421663 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:47:01 [DEBUG   ] Got command RPT from MCS: ref #102496
2019-03-22 11:47:01 [DEBUG   ] summary = ERROR
2019-03-22 11:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102496  13 58564 42421867 A  ERRORERROR'
2019-03-22 11:47:02 [DEBUG   ] Got command RPT from MCS: ref #102498
2019-03-22 11:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102498  77 58564 42422059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:47:02 [DEBUG   ] Got command RPT from MCS: ref #102499
2019-03-22 11:47:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102499  12 58564 42422263 A  ERRORB’™š'
2019-03-22 11:47:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 11:47:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:47:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 11:47:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:47:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:47:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:47:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:47:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:47:38 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-03-22 11:47:41 [DEBUG   ] Got command RPT from MCS: ref #102504
2019-03-22 11:47:41 [DEBUG   ] summary = ERROR
2019-03-22 11:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102504  13 58564 42461079 A  ERRORERROR'
2019-03-22 11:47:41 [DEBUG   ] Got command RPT from MCS: ref #102505
2019-03-22 11:47:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102505  77 58564 42461079 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:47:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 11:48:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 11:48:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:48:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:48:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:48:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:48:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:48:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:48:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:48:38 [DEBUG   ] Finished updating board flags in 1.856 seconds
2019-03-22 11:48:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 11:49:01 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-03-22 11:49:22 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 11:49:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:49:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:49:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:49:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:49:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:49:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:49:38 [DEBUG   ] Finished updating board flags in 1.745 seconds
2019-03-22 11:49:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-03-22 11:50:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:50:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:50:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:50:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:50:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:50:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:50:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:50:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:50:38 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-03-22 11:50:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:51:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:51:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:51:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:51:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:51:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:51:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:51:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:51:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:51:38 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-03-22 11:51:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-03-22 11:52:01 [DEBUG   ] Got command RPT from MCS: ref #102533
2019-03-22 11:52:01 [DEBUG   ] summary = ERROR
2019-03-22 11:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102533  13 58564 42721547 A  ERRORERROR'
2019-03-22 11:52:01 [DEBUG   ] Got command RPT from MCS: ref #102534
2019-03-22 11:52:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102534  77 58564 42721743 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:52:01 [DEBUG   ] Got command RPT from MCS: ref #102535
2019-03-22 11:52:01 [DEBUG   ] summary = ERROR
2019-03-22 11:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102535  13 58564 42721951 A  ERRORERROR'
2019-03-22 11:52:02 [DEBUG   ] Got command RPT from MCS: ref #102536
2019-03-22 11:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102536  77 58564 42722143 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:52:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 11:52:02 [DEBUG   ] Got command RPT from MCS: ref #102537
2019-03-22 11:52:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102537  12 58564 42722347 A  ERRORB’™š'
2019-03-22 11:52:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 11:52:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:52:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:52:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:52:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:52:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:52:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:52:38 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-03-22 11:52:41 [DEBUG   ] Got command RPT from MCS: ref #102538
2019-03-22 11:52:41 [DEBUG   ] summary = ERROR
2019-03-22 11:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102538  13 58564 42761079 A  ERRORERROR'
2019-03-22 11:52:41 [DEBUG   ] Got command RPT from MCS: ref #102539
2019-03-22 11:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102539  77 58564 42761079 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:52:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:53:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 11:53:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 11:53:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:53:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:53:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:53:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:53:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:53:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:53:38 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-03-22 11:53:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 11:54:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 11:54:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 11:54:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:54:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:54:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:54:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:54:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:54:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:54:38 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-03-22 11:54:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 11:55:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 11:55:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 11:55:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:55:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:55:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:55:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:55:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:55:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:55:38 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-03-22 11:55:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 11:56:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 11:56:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 11:56:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:56:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:56:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:56:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:56:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:56:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:56:38 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-03-22 11:56:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 11:57:01 [DEBUG   ] Got command RPT from MCS: ref #102563
2019-03-22 11:57:01 [DEBUG   ] summary = ERROR
2019-03-22 11:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102563  13 58564 43021635 A  ERRORERROR'
2019-03-22 11:57:01 [DEBUG   ] Got command RPT from MCS: ref #102564
2019-03-22 11:57:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102564  77 58564 43021827 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:57:02 [DEBUG   ] Got command RPT from MCS: ref #102565
2019-03-22 11:57:02 [DEBUG   ] summary = ERROR
2019-03-22 11:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102565  13 58564 43022031 A  ERRORERROR'
2019-03-22 11:57:02 [DEBUG   ] Got command RPT from MCS: ref #102567
2019-03-22 11:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102567  77 58564 43022235 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:57:02 [DEBUG   ] Got command RPT from MCS: ref #102569
2019-03-22 11:57:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 11:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102569  12 58564 43022439 A  ERRORB’™š'
2019-03-22 11:57:04 [DEBUG   ] Finished updating ant stats in 1.800 seconds
2019-03-22 11:57:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 11:57:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:57:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:57:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:57:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:57:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:57:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:57:38 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-03-22 11:57:41 [DEBUG   ] Got command RPT from MCS: ref #102579
2019-03-22 11:57:41 [DEBUG   ] summary = ERROR
2019-03-22 11:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102579  13 58564 43061083 A  ERRORERROR'
2019-03-22 11:57:41 [DEBUG   ] Got command RPT from MCS: ref #102580
2019-03-22 11:57:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 11:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102580  77 58564 43061083 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 11:57:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 11:58:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 11:58:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-03-22 11:58:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:58:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:58:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:58:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:58:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:58:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:58:38 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-03-22 11:58:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 11:59:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 11:59:24 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 11:59:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 11:59:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:59:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:59:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:59:38 [WARNING ] (13, 1, 'bot')
2019-03-22 11:59:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 11:59:38 [DEBUG   ] Finished updating board flags in 1.436 seconds
2019-03-22 11:59:44 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-03-22 12:00:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-03-22 12:00:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-03-22 12:00:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:00:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:00:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:00:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:00:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:00:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:00:39 [DEBUG   ] Finished updating board flags in 2.241 seconds
2019-03-22 12:00:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 12:01:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 12:01:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 12:01:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:01:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:01:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:01:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:01:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:01:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:01:39 [DEBUG   ] Finished updating board flags in 2.158 seconds
2019-03-22 12:01:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 12:02:01 [DEBUG   ] Got command RPT from MCS: ref #102602
2019-03-22 12:02:01 [DEBUG   ] summary = ERROR
2019-03-22 12:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102602  13 58564 43321715 A  ERRORERROR'
2019-03-22 12:02:01 [DEBUG   ] Got command RPT from MCS: ref #102603
2019-03-22 12:02:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102603  77 58564 43321919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:02:02 [DEBUG   ] Got command RPT from MCS: ref #102604
2019-03-22 12:02:02 [DEBUG   ] summary = ERROR
2019-03-22 12:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102604  13 58564 43322123 A  ERRORERROR'
2019-03-22 12:02:02 [DEBUG   ] Got command RPT from MCS: ref #102605
2019-03-22 12:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102605  77 58564 43322315 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:02:02 [DEBUG   ] Got command RPT from MCS: ref #102606
2019-03-22 12:02:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 12:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102606  12 58564 43322519 A  ERRORB”™š'
2019-03-22 12:02:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-03-22 12:02:24 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-03-22 12:02:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:02:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:02:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:02:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:02:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:02:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:02:39 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-03-22 12:02:41 [DEBUG   ] Got command RPT from MCS: ref #102607
2019-03-22 12:02:41 [DEBUG   ] summary = ERROR
2019-03-22 12:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102607  13 58564 43361083 A  ERRORERROR'
2019-03-22 12:02:41 [DEBUG   ] Got command RPT from MCS: ref #102608
2019-03-22 12:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102608  77 58564 43361083 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:02:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 12:03:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 12:03:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 12:03:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:03:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:03:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:03:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:03:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:03:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:03:39 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-03-22 12:03:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 12:04:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 12:04:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 12:04:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:04:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:04:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:04:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:04:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:04:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:04:39 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-03-22 12:04:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 12:05:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 12:05:25 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 12:05:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:05:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:05:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:05:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:05:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:05:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:05:39 [DEBUG   ] Finished updating board flags in 1.781 seconds
2019-03-22 12:05:45 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2019-03-22 12:06:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 12:06:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 12:06:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:06:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:06:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:06:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:06:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:06:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:06:39 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-03-22 12:06:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 12:07:01 [DEBUG   ] Got command RPT from MCS: ref #102638
2019-03-22 12:07:01 [DEBUG   ] summary = ERROR
2019-03-22 12:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102638  13 58564 43621807 A  ERRORERROR'
2019-03-22 12:07:01 [DEBUG   ] Got command RPT from MCS: ref #102639
2019-03-22 12:07:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102639  77 58564 43621999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:07:02 [DEBUG   ] Got command RPT from MCS: ref #102640
2019-03-22 12:07:02 [DEBUG   ] summary = ERROR
2019-03-22 12:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102640  13 58564 43622203 A  ERRORERROR'
2019-03-22 12:07:02 [DEBUG   ] Got command RPT from MCS: ref #102642
2019-03-22 12:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102642  77 58564 43622407 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:07:02 [DEBUG   ] Got command RPT from MCS: ref #102643
2019-03-22 12:07:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 12:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102643  12 58564 43622611 A  ERRORB”™š'
2019-03-22 12:07:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 12:07:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 12:07:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:07:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:07:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:07:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:07:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:07:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:07:39 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-03-22 12:07:41 [DEBUG   ] Got command RPT from MCS: ref #102648
2019-03-22 12:07:41 [DEBUG   ] summary = ERROR
2019-03-22 12:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102648  13 58564 43661075 A  ERRORERROR'
2019-03-22 12:07:41 [DEBUG   ] Got command RPT from MCS: ref #102649
2019-03-22 12:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102649  77 58564 43661075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:07:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 12:08:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-03-22 12:08:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 12:08:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:08:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 12:08:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:08:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:08:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:08:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:08:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:08:39 [DEBUG   ] Finished updating board flags in 1.505 seconds
2019-03-22 12:08:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-03-22 12:09:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 12:09:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 12:09:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:09:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:09:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:09:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:09:39 [WARNING ] (13, 1, 'bot')
2019-03-22 12:09:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:09:39 [DEBUG   ] Finished updating board flags in 1.504 seconds
2019-03-22 12:09:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 12:10:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-03-22 12:10:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 12:10:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:10:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:10:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:10:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:10:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:10:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:10:40 [DEBUG   ] Finished updating board flags in 2.273 seconds
2019-03-22 12:10:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 12:11:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 12:11:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 12:11:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:11:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:11:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:11:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:11:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:11:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:11:40 [DEBUG   ] Finished updating board flags in 2.114 seconds
2019-03-22 12:11:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 12:12:01 [DEBUG   ] Got command RPT from MCS: ref #102671
2019-03-22 12:12:01 [DEBUG   ] summary = ERROR
2019-03-22 12:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102671  13 58564 43921891 A  ERRORERROR'
2019-03-22 12:12:02 [DEBUG   ] Got command RPT from MCS: ref #102672
2019-03-22 12:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102672  77 58564 43922095 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:12:02 [DEBUG   ] Got command RPT from MCS: ref #102673
2019-03-22 12:12:02 [DEBUG   ] summary = ERROR
2019-03-22 12:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102673  13 58564 43922287 A  ERRORERROR'
2019-03-22 12:12:02 [DEBUG   ] Got command RPT from MCS: ref #102674
2019-03-22 12:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102674  77 58564 43922491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:12:02 [DEBUG   ] Got command RPT from MCS: ref #102675
2019-03-22 12:12:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 12:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102675  12 58564 43922695 A  ERRORB“™š'
2019-03-22 12:12:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 12:12:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 12:12:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:12:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:12:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:12:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:12:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:12:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:12:40 [DEBUG   ] Finished updating board flags in 2.038 seconds
2019-03-22 12:12:41 [DEBUG   ] Got command RPT from MCS: ref #102682
2019-03-22 12:12:41 [DEBUG   ] summary = ERROR
2019-03-22 12:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102682  13 58564 43961079 A  ERRORERROR'
2019-03-22 12:12:41 [DEBUG   ] Got command RPT from MCS: ref #102683
2019-03-22 12:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102683  77 58564 43961079 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:12:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 12:13:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 12:13:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 12:13:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:13:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:13:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:13:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:13:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:13:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:13:40 [DEBUG   ] Finished updating board flags in 1.962 seconds
2019-03-22 12:13:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 12:14:07 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-03-22 12:14:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-03-22 12:14:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:14:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:14:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:14:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:14:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:14:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:14:40 [DEBUG   ] Finished updating board flags in 1.827 seconds
2019-03-22 12:14:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 12:15:07 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-03-22 12:15:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-03-22 12:15:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:15:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:15:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:15:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:15:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:15:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:15:40 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-03-22 12:15:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 12:16:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 12:16:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 12:16:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:16:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:16:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:16:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:16:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:16:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:16:40 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-03-22 12:16:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-03-22 12:17:01 [DEBUG   ] Got command RPT from MCS: ref #102707
2019-03-22 12:17:01 [DEBUG   ] summary = ERROR
2019-03-22 12:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102707  13 58564 44221979 A  ERRORERROR'
2019-03-22 12:17:02 [DEBUG   ] Got command RPT from MCS: ref #102708
2019-03-22 12:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102708  77 58564 44222175 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:17:02 [DEBUG   ] Got command RPT from MCS: ref #102709
2019-03-22 12:17:02 [DEBUG   ] summary = ERROR
2019-03-22 12:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102709  13 58564 44222379 A  ERRORERROR'
2019-03-22 12:17:02 [DEBUG   ] Got command RPT from MCS: ref #102711
2019-03-22 12:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102711  77 58564 44222571 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:17:02 [DEBUG   ] Got command RPT from MCS: ref #102713
2019-03-22 12:17:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 12:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102713  12 58564 44222775 A  ERRORB“™š'
2019-03-22 12:17:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 12:17:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-03-22 12:17:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:17:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-03-22 12:17:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:17:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:17:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:17:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:17:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:17:40 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-03-22 12:17:41 [DEBUG   ] Got command RPT from MCS: ref #102717
2019-03-22 12:17:41 [DEBUG   ] summary = ERROR
2019-03-22 12:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102717  13 58564 44261079 A  ERRORERROR'
2019-03-22 12:17:41 [DEBUG   ] Got command RPT from MCS: ref #102718
2019-03-22 12:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102718  77 58564 44261079 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:17:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-03-22 12:18:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-03-22 12:18:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-03-22 12:18:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:18:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:18:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:18:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:18:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:18:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:18:40 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-03-22 12:18:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 12:19:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 12:19:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 12:19:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:19:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:19:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:19:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:19:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:19:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:19:40 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-03-22 12:19:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 12:20:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 12:20:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-03-22 12:20:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:20:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:20:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:20:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:20:40 [WARNING ] (13, 1, 'bot')
2019-03-22 12:20:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:20:40 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-03-22 12:20:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-03-22 12:21:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-03-22 12:21:29 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2019-03-22 12:21:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:21:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:21:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:21:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:21:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:21:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:21:41 [DEBUG   ] Finished updating board flags in 2.217 seconds
2019-03-22 12:21:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-03-22 12:22:02 [DEBUG   ] Got command RPT from MCS: ref #102746
2019-03-22 12:22:02 [DEBUG   ] summary = ERROR
2019-03-22 12:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102746  13 58564 44522055 A  ERRORERROR'
2019-03-22 12:22:02 [DEBUG   ] Got command RPT from MCS: ref #102747
2019-03-22 12:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102747  77 58564 44522259 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:22:02 [DEBUG   ] Got command RPT from MCS: ref #102748
2019-03-22 12:22:02 [DEBUG   ] summary = ERROR
2019-03-22 12:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102748  13 58564 44522463 A  ERRORERROR'
2019-03-22 12:22:02 [DEBUG   ] Got command RPT from MCS: ref #102749
2019-03-22 12:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102749  77 58564 44522667 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:22:02 [DEBUG   ] Got command RPT from MCS: ref #102750
2019-03-22 12:22:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-03-22 12:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102750  12 58564 44522859 A  ERRORB”™š'
2019-03-22 12:22:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-03-22 12:22:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-03-22 12:22:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:22:41 [DEBUG   ] Got command RPT from MCS: ref #102751
2019-03-22 12:22:41 [DEBUG   ] summary = ERROR
2019-03-22 12:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102751  13 58564 44561087 A  ERRORERROR'
2019-03-22 12:22:41 [DEBUG   ] Got command RPT from MCS: ref #102752
2019-03-22 12:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-03-22 12:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   102752  77 58564 44561087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-03-22 12:22:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:22:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:22:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:22:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:22:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:22:41 [DEBUG   ] Finished updating board flags in 2.276 seconds
2019-03-22 12:22:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-03-22 12:23:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-03-22 12:23:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-03-22 12:23:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:23:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:23:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:23:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:23:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:23:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:23:41 [DEBUG   ] Finished updating board flags in 2.104 seconds
2019-03-22 12:23:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-03-22 12:24:09 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-03-22 12:24:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-03-22 12:24:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-03-22 12:24:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:24:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:24:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:24:41 [WARNING ] (13, 1, 'bot')
2019-03-22 12:24:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-03-22 12:24:41 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-03-22 12:24:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
